-- Logs begin at Sat 2022-04-30 20:01:17 UTC, end at Sat 2022-04-30 21:12:26 UTC. -- Apr 30 20:39:52.554360 dv-osbrick-master-4-ceph systemd[1]: Starting Devstack devstack@keystone.service... Apr 30 20:39:52.565252 dv-osbrick-master-4-ceph devstack@keystone.service[98579]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Apr 30 20:39:52.567893 dv-osbrick-master-4-ceph devstack@keystone.service[98579]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Apr 30 20:39:52 2022] *** Apr 30 20:39:52.567893 dv-osbrick-master-4-ceph devstack@keystone.service[98579]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 30 20:39:52.567893 dv-osbrick-master-4-ceph devstack@keystone.service[98579]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 30 20:39:52.567893 dv-osbrick-master-4-ceph devstack@keystone.service[98579]: nodename: dv-osbrick-master-4-ceph Apr 30 20:39:52.567893 dv-osbrick-master-4-ceph devstack@keystone.service[98579]: machine: x86_64 Apr 30 20:39:52.567893 dv-osbrick-master-4-ceph devstack@keystone.service[98579]: clock source: unix Apr 30 20:39:52.567893 dv-osbrick-master-4-ceph devstack@keystone.service[98579]: pcre jit disabled Apr 30 20:39:52.567893 dv-osbrick-master-4-ceph devstack@keystone.service[98579]: detected number of CPU cores: 4 Apr 30 20:39:52.567893 dv-osbrick-master-4-ceph devstack@keystone.service[98579]: current working directory: / Apr 30 20:39:52.567893 dv-osbrick-master-4-ceph devstack@keystone.service[98579]: detected binary path: /usr/bin/uwsgi-core Apr 30 20:39:52.567893 dv-osbrick-master-4-ceph devstack@keystone.service[98579]: your processes number limit is 47680 Apr 30 20:39:52.568495 dv-osbrick-master-4-ceph devstack@keystone.service[98579]: your memory page size is 4096 bytes Apr 30 20:39:52.568495 dv-osbrick-master-4-ceph devstack@keystone.service[98579]: detected max file descriptor number: 2048 Apr 30 20:39:52.568495 dv-osbrick-master-4-ceph devstack@keystone.service[98579]: lock engine: pthread robust mutexes Apr 30 20:39:52.568495 dv-osbrick-master-4-ceph devstack@keystone.service[98579]: thunder lock: enabled Apr 30 20:39:52.568495 dv-osbrick-master-4-ceph devstack@keystone.service[98579]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Apr 30 20:39:52.568495 dv-osbrick-master-4-ceph devstack@keystone.service[98579]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 30 20:39:52.617907 dv-osbrick-master-4-ceph devstack@keystone.service[98579]: Python main interpreter initialized at 0x564d7933c9c0 Apr 30 20:39:52.617907 dv-osbrick-master-4-ceph devstack@keystone.service[98579]: python threads support enabled Apr 30 20:39:52.617907 dv-osbrick-master-4-ceph devstack@keystone.service[98579]: your server socket listen backlog is limited to 100 connections Apr 30 20:39:52.617907 dv-osbrick-master-4-ceph devstack@keystone.service[98579]: your mercy for graceful operations on workers is 90 seconds Apr 30 20:39:52.618294 dv-osbrick-master-4-ceph devstack@keystone.service[98579]: mapped 403077 bytes (393 KB) for 2 cores Apr 30 20:39:52.618372 dv-osbrick-master-4-ceph devstack@keystone.service[98579]: *** Operational MODE: preforking *** Apr 30 20:39:52.618589 dv-osbrick-master-4-ceph devstack@keystone.service[98579]: *** uWSGI is running in multiple interpreter mode *** Apr 30 20:39:52.618589 dv-osbrick-master-4-ceph devstack@keystone.service[98579]: spawned uWSGI master process (pid: 98579) Apr 30 20:39:52.618800 dv-osbrick-master-4-ceph systemd[1]: Started Devstack devstack@keystone.service. Apr 30 20:39:52.619891 dv-osbrick-master-4-ceph devstack@keystone.service[98579]: spawned uWSGI worker 1 (pid: 98587, cores: 1) Apr 30 20:39:52.619891 dv-osbrick-master-4-ceph devstack@keystone.service[98579]: spawned uWSGI worker 2 (pid: 98588, cores: 1) Apr 30 20:39:52.620046 dv-osbrick-master-4-ceph devstack@keystone.service[98579]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 30 20:39:58.422318 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 20:39:58.422318 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: from cryptography.utils import int_from_bytes Apr 30 20:39:58.423129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 20:39:58.423129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: from cryptography.utils import int_from_bytes Apr 30 20:39:58.425030 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 20:39:58.425030 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: from cryptography.utils import int_from_bytes Apr 30 20:39:58.425527 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 20:39:58.425527 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: from cryptography.utils import int_from_bytes Apr 30 20:39:58.473643 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 30 20:39:58.473804 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 30 20:39:58.478362 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 30 20:39:58.478469 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 30 20:39:58.478541 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] command line args: [] {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 30 20:39:58.478611 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] command line args: [] {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 30 20:39:58.478676 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 30 20:39:58.478740 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 30 20:39:58.478804 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ================================================================================ {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 30 20:39:58.478868 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ================================================================================ {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 30 20:39:58.478935 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] admin_token = **** {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.478999 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] admin_token = **** {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.479063 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] config_dir = [] {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.479127 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] config_dir = [] {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.479195 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.479260 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.479324 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] config_source = [] {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.479392 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] config_source = [] {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.479456 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] debug = True {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.479520 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] debug = True {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.479584 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.479959 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.479959 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.480107 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.480172 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] insecure_debug = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.480231 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] insecure_debug = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.480293 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.480362 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.480362 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.480465 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.480465 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] list_limit = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.480571 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] list_limit = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.480637 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] log_config_append = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.480700 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] log_config_append = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.480700 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.480813 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.480877 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] log_dir = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.480968 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] log_dir = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.481045 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] log_file = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.481106 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] log_file = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.481169 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.481227 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.481283 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.481345 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.481410 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.481468 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.481468 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.481583 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.481643 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.481701 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.481808 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.481879 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.481943 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.482007 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.482070 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.482148 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.482208 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.482264 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.482325 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.482382 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.482451 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.482517 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.482581 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.482639 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.482700 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.482767 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.482830 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] notification_format = cadf {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.483126 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] notification_format = cadf {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.483542 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.483652 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.483757 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.483862 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.483970 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] publish_errors = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.484068 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] publish_errors = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.484164 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.484270 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.484373 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.484476 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.484556 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.484632 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.484755 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.484950 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.485038 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.485111 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.485185 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] standard_threads = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.485264 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] standard_threads = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.485344 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] strict_password_check = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.485421 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] strict_password_check = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.485544 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.485544 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] use_eventlog = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.485681 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.485762 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] use_journal = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.485839 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] use_eventlog = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.485916 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] use_json = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.485992 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] use_journal = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.486062 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] use_stderr = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.486130 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] use_json = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.486209 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] use_syslog = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.486281 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] use_stderr = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.486281 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] use_syslog = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.486411 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] watch_log_file = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.486486 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] watch_log_file = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:39:58.486557 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.486638 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.486715 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.486791 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.486867 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.486998 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.487141 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.487241 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.487315 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.487385 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.487468 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.487649 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.487754 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.487838 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.487916 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.487993 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.488069 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.488145 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.488215 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.488356 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.488478 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.488556 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.488634 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.488711 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.488781 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.488861 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.488960 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.489039 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.489109 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.489185 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.489255 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.489340 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.489419 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.489501 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.489572 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.489647 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.489717 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.489794 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.489865 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.489940 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.489940 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.490072 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.490141 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.490218 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.490295 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.490371 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.490519 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.490607 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.490768 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.490859 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.490998 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.491078 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.491229 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.491309 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.491458 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.491538 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.491690 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.491768 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.491943 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.492019 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.492191 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.492269 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.492422 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.492500 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.492653 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.492736 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.492925 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.493084 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.493172 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.493246 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.493390 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.493470 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.493637 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.493716 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.493866 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.493945 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.494105 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.494189 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.494337 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.494416 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.494567 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.494645 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.494795 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.494874 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.495027 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.495105 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.495259 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.495344 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.495497 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.495576 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.495751 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.495843 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.495997 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.496080 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.496247 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.496333 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.496481 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.496570 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.496721 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.496799 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.496974 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.497055 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.497226 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.497315 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.497457 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.497536 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.497692 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.497770 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.497926 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.498013 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.498159 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.498238 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.498396 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.498475 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.498629 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.498716 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.498858 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.498942 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.499106 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.499189 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.499341 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.499448 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.499907 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.500807 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.500873 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.501053 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.501053 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.501209 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.501293 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.501367 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.501439 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.501509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.501585 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.501665 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.501738 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.501808 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.501884 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.501964 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.502036 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.502118 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.502196 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.502268 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.502337 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.502413 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.502485 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.503148 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.503302 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.503438 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.503539 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.503612 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.503683 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] cache.enabled = True {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.503809 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] cache.enabled = True {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.503809 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.503952 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.504031 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.504103 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.504173 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.504288 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.504369 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.504533 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.504621 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.504776 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.504856 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.505040 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.505122 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.505282 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.505363 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.505523 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.505602 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.505777 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.505856 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.506020 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.506100 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.506256 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.506336 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.506495 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.506572 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.506728 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.506807 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.506961 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.507037 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.507194 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.507280 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.507424 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.507505 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.507652 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.507746 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.507939 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.508067 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.508151 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.508216 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.508332 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.508448 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.508565 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.508652 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.508796 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.508876 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.512858 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.512993 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.512993 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.513188 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.513188 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.513336 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.513413 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.513492 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.513492 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.513632 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.513705 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] auth.external = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.513775 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.513845 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] auth.mapped = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.513914 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] auth.external = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.513914 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] auth.mapped = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.514048 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.514048 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.514221 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.514296 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] auth.password = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.514367 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.514437 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] auth.token = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.514506 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] auth.password = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.514576 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.514654 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] auth.token = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.514727 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] catalog.caching = True {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.514797 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.514875 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.514948 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] catalog.caching = True {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.515020 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.515098 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.515171 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.515241 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.515311 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.515387 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.515460 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.515601 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.515676 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] credential.caching = True {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.515747 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.515817 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] credential.driver = sql {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.515893 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] credential.caching = True {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.515971 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.516051 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] credential.driver = sql {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.516125 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.516196 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.516267 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.516337 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.516408 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.516486 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.516564 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.516637 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.516707 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.516778 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.516861 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.517048 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.517129 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.517202 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.517273 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.517417 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.517495 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.517577 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.517651 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.517722 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.517794 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.517853 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.517913 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.517980 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.518041 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.518282 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.518906 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] federation.caching = True {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.518990 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.519064 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.519146 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] federation.caching = True {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.519228 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] federation.driver = sql {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.519302 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.519374 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.519445 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] federation.driver = sql {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.519516 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.519595 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.519669 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.519669 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.519797 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.519868 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.519939 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.520019 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.520092 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.520169 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.520241 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.520313 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.520392 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.520466 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.520538 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.520609 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] identity.caching = True {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.520680 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.520789 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.520881 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.521063 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.521145 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] identity.caching = True {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.521301 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.521382 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.521538 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.521635 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.521786 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] identity.driver = sql {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.521908 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.522000 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.522074 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.522240 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.522329 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] identity.driver = sql {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.522485 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.522564 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.522729 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.522810 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.522958 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.523045 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.523187 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.523267 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.523417 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.523497 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.523667 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.523754 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.523903 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.523983 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.524152 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.524235 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.524418 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.524507 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.524672 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.524753 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.524959 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.525043 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.525208 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.525300 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.525449 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.525529 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.525679 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.525758 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.525925 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.526013 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.526154 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.526234 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.526387 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.526466 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.526619 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.526711 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.526857 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.526936 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.527101 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.527179 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.527329 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.527415 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.527576 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.527656 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.527809 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.527896 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.528042 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.528174 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.528370 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.528490 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.528592 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.528691 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.528873 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.529034 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.529119 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.529191 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.529313 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.password = **** {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.529400 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.529548 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.529637 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.529784 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.password = **** {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.529862 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.530026 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.530105 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.530261 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.530349 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.530498 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.530578 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.530745 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.530824 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.530987 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.531076 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.531215 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.531294 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.531446 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.531526 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.531695 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.531777 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.531927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.532006 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.532165 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.532244 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.532400 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.532482 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.532634 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.532714 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.532863 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.user = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.532958 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.533124 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.533246 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.533383 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.533483 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.user = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.533613 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.533728 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.533882 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.534019 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.534226 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.534306 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.534496 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.534619 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.534760 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.534863 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.535013 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.535093 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.535254 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.535334 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.535525 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.535613 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.535764 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.535856 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.535970 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.536059 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.536209 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.536310 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.536451 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.536529 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.536696 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.536775 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.536967 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.537046 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.537197 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.537277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.537426 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.537506 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.547931 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.548053 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.548053 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.548182 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.548182 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.548302 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.548386 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.548461 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.548532 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.548602 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.548673 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.548743 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.548825 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.548898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.549048 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.549120 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.549192 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] policy.driver = sql {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.549262 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.549345 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.549449 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.549527 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.549604 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] policy.driver = sql {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.549678 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.549748 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.549827 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] receipt.caching = True {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.550024 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.550107 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.550187 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.550260 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.550332 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] receipt.caching = True {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.550411 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.550485 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.550556 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.550626 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.550696 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.550767 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.550846 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] resource.caching = True {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.550919 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.550990 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.551060 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.551131 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] resource.driver = sql {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.551202 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] resource.caching = True {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.551280 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.551353 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.551425 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.551494 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] resource.driver = sql {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.551565 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.551641 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.551721 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] revoke.caching = True {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.551799 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.551872 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.551943 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.552013 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.552083 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] revoke.caching = True {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.552162 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] role.cache_time = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.552234 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.552306 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] role.caching = True {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.552375 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.552445 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] role.driver = sql {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.552515 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] role.cache_time = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.552594 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] role.list_limit = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.552667 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] role.caching = True {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.552739 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.552810 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] role.driver = sql {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.552881 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.552982 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] role.list_limit = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.553058 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.553129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.553199 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.553269 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.553340 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.553419 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.553492 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.553563 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.553633 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.553704 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.553774 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.553853 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.553926 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.553997 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.554061 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.554131 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.554202 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.554280 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.554353 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.554424 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.554495 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.554564 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.554636 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.554714 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.554788 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.554859 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.554930 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.554995 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.555065 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.555144 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.555217 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.555289 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.555359 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.555359 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.555483 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.555483 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.555621 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.555692 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.555763 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.555834 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.555907 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.555981 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.556052 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.556122 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.556193 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.556264 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.556342 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.556416 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.556487 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.556557 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.556628 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.556698 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.556776 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.556850 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.556950 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.557027 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.557098 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.557169 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.557252 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] token.cache_time = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.557326 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.557397 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] token.caching = True {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.557467 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.557538 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.557608 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] token.cache_time = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.557691 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] token.provider = fernet {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.557764 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] token.caching = True {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.557835 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.557899 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.557969 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.558039 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] token.provider = fernet {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.558121 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.558196 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.558266 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.558336 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.558406 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.558475 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.558553 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.558626 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.558697 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] trust.driver = sql {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.558767 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.558838 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.558902 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.558979 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.559052 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] trust.driver = sql {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.559123 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.559192 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.559261 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.559331 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.559408 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.559408 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.559533 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.559603 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.559673 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.559673 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.559796 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.559869 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.559939 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] database.connection = **** {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.560017 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.560107 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.560107 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.560277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.560422 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.560498 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] database.connection = **** {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.560578 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.560658 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.560731 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.560802 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.560873 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.560970 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.561058 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.561132 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.561204 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.561273 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.561343 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.561412 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.561490 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.561563 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.561633 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.561703 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.561774 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.561843 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.561922 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.562002 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.562075 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.562145 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.562214 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.562284 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.562363 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.562435 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.562505 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.562574 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.562644 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.562713 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.562791 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 30 20:39:58.562864 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.562864 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.562864 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:39:58.562864 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 30 20:39:58.593805 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=98587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.597945 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=98588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.598039 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=98587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.598103 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=98588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.598176 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=98587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.598253 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=98588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.606435 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=98588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.606623 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=98587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.635500 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=98588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.635732 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=98588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.636305 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=98587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.636539 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=98587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.689123 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=98587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.689744 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=98588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.741569 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=98587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.741795 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=98587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.742045 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=98588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.742289 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=98588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.808581 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.808918 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.809164 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=98588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.809310 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=98587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.809392 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=98588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.809541 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=98587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.809620 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=98588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.809753 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=98587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.809830 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=98588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.809975 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=98587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.810053 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=98588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.810188 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=98587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.836324 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.836523 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.836665 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=98588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.836749 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=98587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.836819 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=98588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.836982 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=98587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.837094 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=98588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.837215 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=98587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.837299 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=98588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.837432 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=98588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.837514 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=98587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.837643 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=98587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.837734 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.837856 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.849079 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=98588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.849236 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=98587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.862624 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.862841 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.862963 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=98588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.863073 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=98587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.863147 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=98588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.863298 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=98588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.863407 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=98587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.863517 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=98587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.863601 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=98588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.863731 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=98587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.863813 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=98588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.863941 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=98587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.864033 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.864150 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:39:58.881944 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.882157 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 30 20:39:58.882280 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.882495 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 30 20:39:58.882578 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.882698 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 30 20:39:58.882833 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.882975 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.883057 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 30 20:39:58.883243 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.883345 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.883504 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.883635 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.883758 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.883902 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.884163 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.894837 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.895115 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.895199 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.895474 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.895571 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.895822 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.895904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.896183 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.904120 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=98588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:39:58.904399 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=98587) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:39:58.907491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=98588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:39:58.907772 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.908058 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.908139 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=98587) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:39:58.908346 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.908428 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.908633 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.908714 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.908959 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.909069 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.909218 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.909350 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.909496 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.909613 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.909770 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.909885 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.910051 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.910160 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.910419 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.910500 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.910693 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.911058 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.937807 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.938388 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.939487 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=98588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:39:58.939730 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.940021 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=98587) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:39:58.941079 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.945812 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=98588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:39:58.946096 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.946379 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.946538 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=98587) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:39:58.946813 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.947094 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.953908 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=98588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:39:58.954194 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.954487 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=98587) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:39:58.954771 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.958805 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=98588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:39:58.959094 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.959368 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=98587) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:39:58.959463 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.959652 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.959734 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.959927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.960007 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.960204 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.960293 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.960474 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.960590 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.960749 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.960866 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.961153 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.961425 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.980269 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.980557 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.980793 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.981148 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.985416 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=98588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:39:58.985893 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=98587) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:39:58.989690 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.989993 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.990155 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.990415 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:58.995201 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=98588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:39:58.995557 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=98587) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:39:58.999120 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=98588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:39:58.999785 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=98587) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:39:59.003389 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.003688 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.003976 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.004104 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.004263 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.004404 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.004545 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.004689 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.004970 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.005099 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.005273 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.005665 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.024218 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=98588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:39:59.024504 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.024776 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.025037 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=98587) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:39:59.025125 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.025324 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.025616 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.025885 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.033215 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.034137 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.035117 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.035396 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.035871 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.036149 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.038533 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=98588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:39:59.038816 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.039100 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.039315 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=98587) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:39:59.039412 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.039594 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.039676 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.039888 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.040167 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.040443 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.054670 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=98588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:39:59.054953 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=98587) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:39:59.055036 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.055233 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.055314 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.055514 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.055596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.055801 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.055883 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.056083 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.056174 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.056359 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.056440 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.056639 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.075300 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=98587) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:39:59.075404 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=98588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:39:59.078750 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=98587) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:39:59.078840 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=98588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:39:59.082185 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.082519 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.083788 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.084148 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.085461 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=98587) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:39:59.085739 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.085834 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=98588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:39:59.086019 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.086102 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.086373 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.093456 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.093907 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.096398 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=98587) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:39:59.097142 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=98588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:39:59.099722 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.100012 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.100548 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.100708 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.100827 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.101028 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.101321 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.101604 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.110116 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=98587) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:39:59.110401 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.110686 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.110946 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=98588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:39:59.111236 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.111519 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.119310 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=98587) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:39:59.119588 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.119867 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.120145 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.120306 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=98588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:39:59.120405 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.120590 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.120672 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.120875 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.120976 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.121180 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.121275 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.121458 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.121538 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.121733 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.121813 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.122012 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.122095 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.122269 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.122349 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.122558 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.122714 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.122825 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=98587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.122906 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.123104 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.123368 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.123633 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.123921 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=98588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:39:59.162078 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x564d7933c9c0 pid: 98587 (default app) Apr 30 20:39:59.163650 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x564d7933c9c0 pid: 98588 (default app) Apr 30 20:39:59.165358 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59565c47-ab97-4cc6-a452-f76437412fa7 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:39:59.165652 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59565c47-ab97-4cc6-a452-f76437412fa7 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:39:59.165931 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59565c47-ab97-4cc6-a452-f76437412fa7 None None] PATH_INFO: `/v3` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:39:59.170238 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 791 bytes} [Sat Apr 30 20:39:59 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:08.300640 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17dfcb7-b22c-4b85-9c4e-222c0ce84110 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:08.301193 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17dfcb7-b22c-4b85-9c4e-222c0ce84110 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:08.301193 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17dfcb7-b22c-4b85-9c4e-222c0ce84110 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:08.305640 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:40:08.310887 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95861d22-1c70-496d-a7cd-0a7802f69221 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:08.311290 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95861d22-1c70-496d-a7cd-0a7802f69221 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:08.311433 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95861d22-1c70-496d-a7cd-0a7802f69221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:08.342145 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG oslo_db.sqlalchemy.engines [None req-95861d22-1c70-496d-a7cd-0a7802f69221 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98587) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 20:40:08.525545 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG passlib.handlers.bcrypt [None req-95861d22-1c70-496d-a7cd-0a7802f69221 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=98587) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 30 20:40:08.525970 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG passlib.handlers.bcrypt [None req-95861d22-1c70-496d-a7cd-0a7802f69221 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=98587) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 30 20:40:08.581430 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-95861d22-1c70-496d-a7cd-0a7802f69221 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:08.582993 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-95861d22-1c70-496d-a7cd-0a7802f69221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:08.706766 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Apr 30 20:40:08.860069 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17dfcb7-b22c-4b85-9c4e-222c0ce84110 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:08.893750 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG oslo_db.sqlalchemy.engines [None req-b17dfcb7-b22c-4b85-9c4e-222c0ce84110 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98588) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 20:40:09.018299 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17dfcb7-b22c-4b85-9c4e-222c0ce84110 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:09.022593 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75d9af-5305-42e4-81a4-567282271ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:09.023256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75d9af-5305-42e4-81a4-567282271ece admin admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:09.023542 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75d9af-5305-42e4-81a4-567282271ece admin admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:09.023823 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75d9af-5305-42e4-81a4-567282271ece admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:09.031856 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75d9af-5305-42e4-81a4-567282271ece admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:09.084072 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6b75d9af-5305-42e4-81a4-567282271ece admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 30 20:40:09.084417 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75d9af-5305-42e4-81a4-567282271ece admin admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:09.094024 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1324 bytes} [Sat Apr 30 20:40:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 30 20:40:09.100758 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95861d22-1c70-496d-a7cd-0a7802f69221 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:09.115413 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95861d22-1c70-496d-a7cd-0a7802f69221 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:09.119756 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb96f17-74e1-4bd4-928e-670186ef8c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:09.120864 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb96f17-74e1-4bd4-928e-670186ef8c44 admin admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:09.121184 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb96f17-74e1-4bd4-928e-670186ef8c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:09.121488 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb96f17-74e1-4bd4-928e-670186ef8c44 admin admin] PATH_INFO: `/v3/projects/d7eaab61e23a485db5f1e2bf1736a9f5` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:09.122953 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb96f17-74e1-4bd4-928e-670186ef8c44 admin admin] RBAC: Authorizing `identity:get_project(project_id=d7eaab61e23a485db5f1e2bf1736a9f5)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:09.173882 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fbb96f17-74e1-4bd4-928e-670186ef8c44 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 30 20:40:09.174994 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb96f17-74e1-4bd4-928e-670186ef8c44 admin admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:09.180796 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 3/5] 10.222.0.26 () {56 vars in 1207 bytes} [Sat Apr 30 20:40:09 2022] GET /identity/v3/projects/d7eaab61e23a485db5f1e2bf1736a9f5 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:11.430246 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6cf67-30cb-4214-9ccd-cc681c2359c3 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:11.430862 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6cf67-30cb-4214-9ccd-cc681c2359c3 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:11.430862 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6cf67-30cb-4214-9ccd-cc681c2359c3 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:11.434957 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 3/6] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:11.440879 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c6990-4e99-47ec-bf29-f9e3b72e2ac6 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:11.441311 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c6990-4e99-47ec-bf29-f9e3b72e2ac6 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:11.449228 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c6990-4e99-47ec-bf29-f9e3b72e2ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:11.460520 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-187c6990-4e99-47ec-bf29-f9e3b72e2ac6 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:11.462067 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-187c6990-4e99-47ec-bf29-f9e3b72e2ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:11.469852 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Apr 30 20:40:11.493279 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6cf67-30cb-4214-9ccd-cc681c2359c3 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:11.506168 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6cf67-30cb-4214-9ccd-cc681c2359c3 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:11.510498 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944170e-8390-40cf-9745-4bf63321810c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:11.511126 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944170e-8390-40cf-9745-4bf63321810c admin admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:11.511412 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944170e-8390-40cf-9745-4bf63321810c admin admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:11.511689 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944170e-8390-40cf-9745-4bf63321810c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:11.520238 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b944170e-8390-40cf-9745-4bf63321810c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:11.522110 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b944170e-8390-40cf-9745-4bf63321810c admin admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:11.530769 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1324 bytes} [Sat Apr 30 20:40:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 20:40:11.536261 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c6990-4e99-47ec-bf29-f9e3b72e2ac6 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:11.545132 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c6990-4e99-47ec-bf29-f9e3b72e2ac6 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:11.549972 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90632b-7938-4895-8f38-c5b4368d0135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:11.550819 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90632b-7938-4895-8f38-c5b4368d0135 admin admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:11.551156 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90632b-7938-4895-8f38-c5b4368d0135 admin admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:11.551410 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90632b-7938-4895-8f38-c5b4368d0135 admin admin] PATH_INFO: `/v3/users/71f9c03c5c0b40ce81ea052befa2a06c` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:11.552783 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90632b-7938-4895-8f38-c5b4368d0135 admin admin] RBAC: Authorizing `identity:get_user(user_id=71f9c03c5c0b40ce81ea052befa2a06c)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:11.554648 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90632b-7938-4895-8f38-c5b4368d0135 admin admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:11.556307 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 5/9] 10.222.0.26 () {56 vars in 1198 bytes} [Sat Apr 30 20:40:11 2022] GET /identity/v3/users/71f9c03c5c0b40ce81ea052befa2a06c => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:13.881096 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e172a-dcfb-46f9-a6ed-9f5e7742529f None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:13.881598 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e172a-dcfb-46f9-a6ed-9f5e7742529f None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:13.881670 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e172a-dcfb-46f9-a6ed-9f5e7742529f None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:13.883006 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:13.888347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2754c-794a-4fdd-9e45-372176e0dee3 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:13.888734 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2754c-794a-4fdd-9e45-372176e0dee3 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:13.888923 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2754c-794a-4fdd-9e45-372176e0dee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:13.905935 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-0fe2754c-794a-4fdd-9e45-372176e0dee3 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:13.907108 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-0fe2754c-794a-4fdd-9e45-372176e0dee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:13.931449 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fcea1-27a7-4bd3-bacd-ecdf352238af None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:13.931750 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fcea1-27a7-4bd3-bacd-ecdf352238af None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:13.932035 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fcea1-27a7-4bd3-bacd-ecdf352238af None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:13.933420 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 6/11] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:40:13.938440 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c5242-928a-4585-8018-f1583d5912f8 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:13.938726 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c5242-928a-4585-8018-f1583d5912f8 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:13.939005 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c5242-928a-4585-8018-f1583d5912f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:13.980350 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG passlib.handlers.bcrypt [None req-ee8c5242-928a-4585-8018-f1583d5912f8 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=98588) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 30 20:40:13.980774 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG passlib.handlers.bcrypt [None req-ee8c5242-928a-4585-8018-f1583d5912f8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=98588) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 30 20:40:13.986797 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:40:14.010598 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2754c-794a-4fdd-9e45-372176e0dee3 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:14.027414 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-ee8c5242-928a-4585-8018-f1583d5912f8 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:14.029054 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-ee8c5242-928a-4585-8018-f1583d5912f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:14.107993 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2754c-794a-4fdd-9e45-372176e0dee3 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:14.123332 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:40:14.140631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b9a93-5ea5-4bdf-8789-8cf5584a59bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:14.141452 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b9a93-5ea5-4bdf-8789-8cf5584a59bb None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:14.141742 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b9a93-5ea5-4bdf-8789-8cf5584a59bb None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:14.142025 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b9a93-5ea5-4bdf-8789-8cf5584a59bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:14.146613 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c5242-928a-4585-8018-f1583d5912f8 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:14.154132 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b9a93-5ea5-4bdf-8789-8cf5584a59bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:40:14.165293 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-847b9a93-5ea5-4bdf-8789-8cf5584a59bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:40:14.165293 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:40:14.165293 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:40:14.165293 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:40:14.165293 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:40:14.165293 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:40:14.165293 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:40:14.165293 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:40:14.165293 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:40:14.165293 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:40:14.165293 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:40:14.165293 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:40:14.165293 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:40:14.165293 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:40:14.165293 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:40:14.165293 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:40:14.166241 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:40:14.166241 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:40:14.166241 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:40:14.166241 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:40:14.166241 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:40:14.166241 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:40:14.166241 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:40:14.166241 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:40:14.166241 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:40:14.166241 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:40:14.166241 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:40:14.166241 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:40:14.166241 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:40:14.166241 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:40:14.166241 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:40:14.166241 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:40:14.167347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:40:14.167347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:40:14.167347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:40:14.167347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:40:14.167347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:40:14.167347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:40:14.167347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:40:14.167347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:40:14.167347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:40:14.167347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:40:14.167347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:40:14.167347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:40:14.167347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 7/14] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Apr 30 20:40:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:40:14.172164 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b9a93-5ea5-4bdf-8789-8cf5584a59bb None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:14.240819 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c5242-928a-4585-8018-f1583d5912f8 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:14.265945 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b9a93-5ea5-4bdf-8789-8cf5584a59bb None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:14.273239 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a24370-153e-4986-a0bd-be053a8ecd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:14.274124 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a24370-153e-4986-a0bd-be053a8ecd5b None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:14.274401 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a24370-153e-4986-a0bd-be053a8ecd5b None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:14.274667 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a24370-153e-4986-a0bd-be053a8ecd5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:14.299629 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9e1a9-9bad-4f48-bac9-86395638efe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:14.300285 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9e1a9-9bad-4f48-bac9-86395638efe7 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:14.300574 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9e1a9-9bad-4f48-bac9-86395638efe7 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:14.300854 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9e1a9-9bad-4f48-bac9-86395638efe7 None admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:14.301639 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9e1a9-9bad-4f48-bac9-86395638efe7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:14.301951 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9e1a9-9bad-4f48-bac9-86395638efe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:14.303369 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9e1a9-9bad-4f48-bac9-86395638efe7 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:14.315418 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 8/15] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:40:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:40:14.320879 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9e1a9-9bad-4f48-bac9-86395638efe7 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:14.339889 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a24370-153e-4986-a0bd-be053a8ecd5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:14.341433 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a24370-153e-4986-a0bd-be053a8ecd5b None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:14.438402 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 8/16] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:40:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 30 20:40:14.444477 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a24370-153e-4986-a0bd-be053a8ecd5b None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:14.531144 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9e1a9-9bad-4f48-bac9-86395638efe7 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:14.566491 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61c565-78df-4dc4-b7b8-f74f0c0e0532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:14.567401 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61c565-78df-4dc4-b7b8-f74f0c0e0532 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:14.567655 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61c565-78df-4dc4-b7b8-f74f0c0e0532 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:14.567935 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61c565-78df-4dc4-b7b8-f74f0c0e0532 None admin] PATH_INFO: `/v3/users/71f9c03c5c0b40ce81ea052befa2a06c` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:14.569180 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61c565-78df-4dc4-b7b8-f74f0c0e0532 None admin] RBAC: Authorizing `identity:get_user(user_id=71f9c03c5c0b40ce81ea052befa2a06c)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:14.570663 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61c565-78df-4dc4-b7b8-f74f0c0e0532 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:14.572288 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 9/17] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Apr 30 20:40:14 2022] GET /identity/v3/users/71f9c03c5c0b40ce81ea052befa2a06c => generated 247 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:40:14.577565 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61c565-78df-4dc4-b7b8-f74f0c0e0532 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:14.649556 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a24370-153e-4986-a0bd-be053a8ecd5b None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:14.672410 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61c565-78df-4dc4-b7b8-f74f0c0e0532 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:14.682105 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4b4d8-e584-416b-9bf5-0687de9c9dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:14.682896 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4b4d8-e584-416b-9bf5-0687de9c9dfb None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:14.683182 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4b4d8-e584-416b-9bf5-0687de9c9dfb None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:14.683480 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4b4d8-e584-416b-9bf5-0687de9c9dfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:14.701486 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d4b4d8-e584-416b-9bf5-0687de9c9dfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:14.702888 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d4b4d8-e584-416b-9bf5-0687de9c9dfb None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:14.704558 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c9181-96b0-4046-b7f8-48db2fc61a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:14.706005 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c9181-96b0-4046-b7f8-48db2fc61a47 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:14.706525 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c9181-96b0-4046-b7f8-48db2fc61a47 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:14.706884 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c9181-96b0-4046-b7f8-48db2fc61a47 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:14.708110 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c9181-96b0-4046-b7f8-48db2fc61a47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:14.709612 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c9181-96b0-4046-b7f8-48db2fc61a47 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:14.711402 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 10/18] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:40:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:40:14.716837 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c9181-96b0-4046-b7f8-48db2fc61a47 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:14.723695 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-56d4b4d8-e584-416b-9bf5-0687de9c9dfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:40:14.723695 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:40:14.723695 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:40:14.723695 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:40:14.723695 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:40:14.723695 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:40:14.723695 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:40:14.723695 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:40:14.723695 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:40:14.723695 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:40:14.723695 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:40:14.723695 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:40:14.723695 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:40:14.723695 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:40:14.723695 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:40:14.724564 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:40:14.724564 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:40:14.724564 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:40:14.724564 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:40:14.724564 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:40:14.724564 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:40:14.724564 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:40:14.724564 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:40:14.724564 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:40:14.724564 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:40:14.724564 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:40:14.724564 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:40:14.724564 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:40:14.724564 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:40:14.724564 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:40:14.724564 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:40:14.724564 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:40:14.730388 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:40:14.730388 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:40:14.730388 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:40:14.730388 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:40:14.730388 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 9/19] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:40:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:40:14.730935 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4b4d8-e584-416b-9bf5-0687de9c9dfb None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:14.814229 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c9181-96b0-4046-b7f8-48db2fc61a47 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:14.828693 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4b4d8-e584-416b-9bf5-0687de9c9dfb None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:14.844551 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684aceb3-1f3f-4cd4-9e1c-725396bbb0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:14.845242 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684aceb3-1f3f-4cd4-9e1c-725396bbb0ac None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:14.845523 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684aceb3-1f3f-4cd4-9e1c-725396bbb0ac None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:14.845799 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684aceb3-1f3f-4cd4-9e1c-725396bbb0ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:14.846806 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684aceb3-1f3f-4cd4-9e1c-725396bbb0ac None admin] RBAC: Adding query filter params (role.id=31b3f11a82cd4cd2823e88aa0e931323, scope.domain.id=default, user.id=71f9c03c5c0b40ce81ea052befa2a06c) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:14.847116 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684aceb3-1f3f-4cd4-9e1c-725396bbb0ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:14.848570 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684aceb3-1f3f-4cd4-9e1c-725396bbb0ac None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:14.855361 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 11/20] 10.222.0.26 () {56 vars in 1322 bytes} [Sat Apr 30 20:40:14 2022] GET /identity/v3/role_assignments?user.id=71f9c03c5c0b40ce81ea052befa2a06c&scope.domain.id=default&role.id=31b3f11a82cd4cd2823e88aa0e931323 => generated 233 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:40:14.861429 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52fa88-b50d-4800-ab69-d6fb072f9acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:14.862629 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52fa88-b50d-4800-ab69-d6fb072f9acd None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:14.862938 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52fa88-b50d-4800-ab69-d6fb072f9acd None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:14.863187 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52fa88-b50d-4800-ab69-d6fb072f9acd None admin] PATH_INFO: `/v3/domains` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:14.863924 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52fa88-b50d-4800-ab69-d6fb072f9acd None admin] RBAC: Adding query filter params (name=Default) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:14.864231 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52fa88-b50d-4800-ab69-d6fb072f9acd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:14.865696 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52fa88-b50d-4800-ab69-d6fb072f9acd None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:14.886319 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 10/21] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:40:17.615836 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d39e1d-2b95-401d-9c68-b451b24fd7fe None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:17.616891 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d39e1d-2b95-401d-9c68-b451b24fd7fe None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:17.617414 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d39e1d-2b95-401d-9c68-b451b24fd7fe None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:17.619298 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 12/22] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:17.624576 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c308d41-bad8-4507-bcbb-81c978468afa None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:17.625491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c308d41-bad8-4507-bcbb-81c978468afa None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:17.625979 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c308d41-bad8-4507-bcbb-81c978468afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:17.654107 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-4c308d41-bad8-4507-bcbb-81c978468afa None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:17.655695 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-4c308d41-bad8-4507-bcbb-81c978468afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:17.758904 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 11/23] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:40:17.798424 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d39e1d-2b95-401d-9c68-b451b24fd7fe None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:17.908962 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b4cef-2791-46fd-8f07-c455f1518599 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:17.909589 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b4cef-2791-46fd-8f07-c455f1518599 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:17.910102 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b4cef-2791-46fd-8f07-c455f1518599 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:17.911949 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 12/24] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:17.919465 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f5a99-ca50-4f63-b2ae-1d7177e2f754 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:17.919465 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f5a99-ca50-4f63-b2ae-1d7177e2f754 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:17.919465 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f5a99-ca50-4f63-b2ae-1d7177e2f754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:17.945407 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-7b2f5a99-ca50-4f63-b2ae-1d7177e2f754 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:17.946603 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-7b2f5a99-ca50-4f63-b2ae-1d7177e2f754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:17.949651 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d39e1d-2b95-401d-9c68-b451b24fd7fe None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:18.013780 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6d178-72a3-4ab2-95f5-0db8635e06b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:18.014610 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6d178-72a3-4ab2-95f5-0db8635e06b4 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:18.014905 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6d178-72a3-4ab2-95f5-0db8635e06b4 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:18.015187 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6d178-72a3-4ab2-95f5-0db8635e06b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:18.040116 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a6d178-72a3-4ab2-95f5-0db8635e06b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:40:18.047812 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-21a6d178-72a3-4ab2-95f5-0db8635e06b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:40:18.047812 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:40:18.047812 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:40:18.047812 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:40:18.047812 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:40:18.047812 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:40:18.047812 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:40:18.047812 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:40:18.047812 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:40:18.047812 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:40:18.047812 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:40:18.047812 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:40:18.047812 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:40:18.047812 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:40:18.047812 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:40:18.047812 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:40:18.048653 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:40:18.048653 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:40:18.048653 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:40:18.048653 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:40:18.048653 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:40:18.048653 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:40:18.048653 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:40:18.048653 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:40:18.048653 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:40:18.048653 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:40:18.048653 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:40:18.048653 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:40:18.048653 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:40:18.048653 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:40:18.048653 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:40:18.048653 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:40:18.050155 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:40:18.050155 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:40:18.050155 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:40:18.050155 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:40:18.050155 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:40:18.050155 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:40:18.050155 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:40:18.050155 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:40:18.050155 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:40:18.050155 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:40:18.050155 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:40:18.050155 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:40:18.052339 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 13/25] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Apr 30 20:40:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:40:18.054657 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442ee2d-1796-4583-8630-cd787db5bb6b None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:18.056410 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442ee2d-1796-4583-8630-cd787db5bb6b None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:18.057647 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442ee2d-1796-4583-8630-cd787db5bb6b None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:18.063871 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 14/26] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:18 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:18.069890 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442ee2d-1796-4583-8630-cd787db5bb6b None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:18.091918 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 13/27] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:40:18.094766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddd362-dda5-4e19-9762-df11a271d146 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:18.096599 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddd362-dda5-4e19-9762-df11a271d146 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:18.098005 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddd362-dda5-4e19-9762-df11a271d146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:18.125552 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-3bddd362-dda5-4e19-9762-df11a271d146 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:18.127324 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-3bddd362-dda5-4e19-9762-df11a271d146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:18.245540 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 14/28] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:40:18.246568 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bddd362-dda5-4e19-9762-df11a271d146 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:18.309592 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442ee2d-1796-4583-8630-cd787db5bb6b None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:18.382603 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bddd362-dda5-4e19-9762-df11a271d146 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:18.389627 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de4140-50b0-4a9f-a612-cdcb0d7e2b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:18.390312 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de4140-50b0-4a9f-a612-cdcb0d7e2b5e None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:18.390595 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de4140-50b0-4a9f-a612-cdcb0d7e2b5e None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:18.390873 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de4140-50b0-4a9f-a612-cdcb0d7e2b5e None admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:18.391626 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de4140-50b0-4a9f-a612-cdcb0d7e2b5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:18.391935 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de4140-50b0-4a9f-a612-cdcb0d7e2b5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:18.397665 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de4140-50b0-4a9f-a612-cdcb0d7e2b5e None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:18.414640 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 15/29] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:40:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:18.415814 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de4140-50b0-4a9f-a612-cdcb0d7e2b5e None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:18.422293 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9bb53-809c-40dc-903b-7e859fd02dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:18.422293 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9bb53-809c-40dc-903b-7e859fd02dff None admin] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:18.422293 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9bb53-809c-40dc-903b-7e859fd02dff None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:18.422293 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9bb53-809c-40dc-903b-7e859fd02dff None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:18.422663 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9bb53-809c-40dc-903b-7e859fd02dff None admin] RBAC: Authorizing `identity:create_role()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:18.422663 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9bb53-809c-40dc-903b-7e859fd02dff None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:18.524727 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de4140-50b0-4a9f-a612-cdcb0d7e2b5e None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:18.561648 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c6908a-0ce3-4872-951e-312683272a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:18.563095 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6908a-0ce3-4872-951e-312683272a57 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:18.563614 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6908a-0ce3-4872-951e-312683272a57 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:18.564100 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6908a-0ce3-4872-951e-312683272a57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:18.575755 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c6908a-0ce3-4872-951e-312683272a57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:18.577672 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c6908a-0ce3-4872-951e-312683272a57 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:18.598222 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-b2c6908a-0ce3-4872-951e-312683272a57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:40:18.598222 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:40:18.598222 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:40:18.598222 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:40:18.598222 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:40:18.598222 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:40:18.598222 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:40:18.598222 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:40:18.598222 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:40:18.598222 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:40:18.598222 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:40:18.598222 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:40:18.598222 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:40:18.598222 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:40:18.598222 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:40:18.599085 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:40:18.599085 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:40:18.599085 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:40:18.599085 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:40:18.599085 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:40:18.599085 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:40:18.599085 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:40:18.599085 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:40:18.599085 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:40:18.599085 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:40:18.599085 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:40:18.599085 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:40:18.599085 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:40:18.599085 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:40:18.599085 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:40:18.599085 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:40:18.599085 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:40:18.599891 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:40:18.599891 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:40:18.599891 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:40:18.599891 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:40:18.608581 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 16/30] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:40:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:40:18.610295 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b800fa7-2ade-4e1d-900e-4660e18ff82d None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:18.610813 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b800fa7-2ade-4e1d-900e-4660e18ff82d None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:18.611294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b800fa7-2ade-4e1d-900e-4660e18ff82d None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:18.613307 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 17/31] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:18.614199 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b800fa7-2ade-4e1d-900e-4660e18ff82d None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:18.673078 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 15/32] 10.222.0.26 () {60 vars in 1131 bytes} [Sat Apr 30 20:40:18 2022] POST /identity/v3/roles => generated 225 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:40:18.674615 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9bb53-809c-40dc-903b-7e859fd02dff None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:18.735887 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b800fa7-2ade-4e1d-900e-4660e18ff82d None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:18.780656 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69007d-0bf9-4d02-8a24-12ea3fd0d435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:18.782085 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69007d-0bf9-4d02-8a24-12ea3fd0d435 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:18.782578 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69007d-0bf9-4d02-8a24-12ea3fd0d435 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:18.783032 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69007d-0bf9-4d02-8a24-12ea3fd0d435 None admin] PATH_INFO: `/v3/users/71f9c03c5c0b40ce81ea052befa2a06c` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:18.785972 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af69007d-0bf9-4d02-8a24-12ea3fd0d435 None admin] RBAC: Authorizing `identity:get_user(user_id=71f9c03c5c0b40ce81ea052befa2a06c)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:18.787740 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af69007d-0bf9-4d02-8a24-12ea3fd0d435 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:18.794995 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 18/33] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Apr 30 20:40:18 2022] GET /identity/v3/users/71f9c03c5c0b40ce81ea052befa2a06c => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:18.797066 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ccf1a-8b0f-432c-8eb2-b5fc158f620c None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:18.797543 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ccf1a-8b0f-432c-8eb2-b5fc158f620c None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:18.798199 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ccf1a-8b0f-432c-8eb2-b5fc158f620c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:18.836939 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-f91ccf1a-8b0f-432c-8eb2-b5fc158f620c None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:18.842673 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-f91ccf1a-8b0f-432c-8eb2-b5fc158f620c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:18.891614 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9bb53-809c-40dc-903b-7e859fd02dff None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:18.932781 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a010b-2351-431f-9f33-cad70a61adb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:18.933617 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a010b-2351-431f-9f33-cad70a61adb0 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:18.934856 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a010b-2351-431f-9f33-cad70a61adb0 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:18.935221 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a010b-2351-431f-9f33-cad70a61adb0 None admin] PATH_INFO: `/v3/domains` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:18.935984 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a010b-2351-431f-9f33-cad70a61adb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:18.936359 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a010b-2351-431f-9f33-cad70a61adb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:18.938195 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a010b-2351-431f-9f33-cad70a61adb0 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:18.952794 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 16/34] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:18.954094 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a010b-2351-431f-9f33-cad70a61adb0 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:18.997293 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 19/35] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:40:18.997851 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ccf1a-8b0f-432c-8eb2-b5fc158f620c None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:19.092847 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a010b-2351-431f-9f33-cad70a61adb0 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:19.129477 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ccf1a-8b0f-432c-8eb2-b5fc158f620c None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:19.130438 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b997a-0e49-4504-b670-210047661228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:19.131241 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b997a-0e49-4504-b670-210047661228 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:19.131526 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b997a-0e49-4504-b670-210047661228 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:19.131814 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b997a-0e49-4504-b670-210047661228 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:19.133381 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b997a-0e49-4504-b670-210047661228 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:19.134856 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b997a-0e49-4504-b670-210047661228 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:19.141461 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 17/36] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:40:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:19.141461 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456e5bc-2915-4aec-a7c0-bbad508ce8fb None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:19.141461 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456e5bc-2915-4aec-a7c0-bbad508ce8fb None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:19.141461 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456e5bc-2915-4aec-a7c0-bbad508ce8fb None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:19.141461 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 18/37] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:19.141461 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456e5bc-2915-4aec-a7c0-bbad508ce8fb None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:19.171257 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9590056-1f44-45e5-917a-3de384a4eb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:19.171924 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9590056-1f44-45e5-917a-3de384a4eb4c None admin] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:19.172214 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9590056-1f44-45e5-917a-3de384a4eb4c None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:19.172528 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9590056-1f44-45e5-917a-3de384a4eb4c None admin] PATH_INFO: `/v3/projects` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:19.173307 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9590056-1f44-45e5-917a-3de384a4eb4c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:19.175771 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9590056-1f44-45e5-917a-3de384a4eb4c None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:19.245807 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456e5bc-2915-4aec-a7c0-bbad508ce8fb None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:19.278521 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecbe99-0fe8-4614-87c6-1302cd1a6b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:19.279187 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecbe99-0fe8-4614-87c6-1302cd1a6b3c None admin] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:19.279475 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecbe99-0fe8-4614-87c6-1302cd1a6b3c None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:19.279752 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecbe99-0fe8-4614-87c6-1302cd1a6b3c None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:19.280486 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ecbe99-0fe8-4614-87c6-1302cd1a6b3c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:19.281935 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ecbe99-0fe8-4614-87c6-1302cd1a6b3c None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:19.347212 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 19/38] 10.222.0.26 () {60 vars in 1131 bytes} [Sat Apr 30 20:40:19 2022] POST /identity/v3/roles => generated 219 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:40:19.347937 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecbe99-0fe8-4614-87c6-1302cd1a6b3c None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:19.416942 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 20/39] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Apr 30 20:40:18 2022] POST /identity/v3/projects => generated 301 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:40:19.416942 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446af03f-6308-45a8-9553-de8fdbc350da None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:19.416942 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446af03f-6308-45a8-9553-de8fdbc350da None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:19.416942 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446af03f-6308-45a8-9553-de8fdbc350da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:19.449224 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-446af03f-6308-45a8-9553-de8fdbc350da None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:19.451029 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-446af03f-6308-45a8-9553-de8fdbc350da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:19.504860 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecbe99-0fe8-4614-87c6-1302cd1a6b3c None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:19.539842 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 21/40] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:40:19.541681 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd7499-2746-42c9-bf03-f698626b1813 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:19.542060 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd7499-2746-42c9-bf03-f698626b1813 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:19.542428 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd7499-2746-42c9-bf03-f698626b1813 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:19.543920 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 22/41] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:19.554569 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5feb38-1d36-4933-8fcd-d171fa9f4db4 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:19.554866 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5feb38-1d36-4933-8fcd-d171fa9f4db4 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:19.555177 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5feb38-1d36-4933-8fcd-d171fa9f4db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:19.556673 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d87d3f-29af-4416-9160-99388480d60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:19.556863 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d87d3f-29af-4416-9160-99388480d60a None admin] REQUEST_METHOD: `PUT` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:19.557227 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d87d3f-29af-4416-9160-99388480d60a None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:19.557397 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d87d3f-29af-4416-9160-99388480d60a None admin] PATH_INFO: `/v3/domains/default/users/71f9c03c5c0b40ce81ea052befa2a06c/roles/31b3f11a82cd4cd2823e88aa0e931323` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:19.559809 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d87d3f-29af-4416-9160-99388480d60a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=71f9c03c5c0b40ce81ea052befa2a06c, role_id=31b3f11a82cd4cd2823e88aa0e931323)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:19.561362 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d87d3f-29af-4416-9160-99388480d60a None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:19.584396 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-de5feb38-1d36-4933-8fcd-d171fa9f4db4 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:19.585681 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-de5feb38-1d36-4933-8fcd-d171fa9f4db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:19.661008 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 23/42] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:40:19.661805 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5feb38-1d36-4933-8fcd-d171fa9f4db4 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:19.680391 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 20/43] 10.222.0.26 () {58 vars in 1361 bytes} [Sat Apr 30 20:40:19 2022] PUT /identity/v3/domains/default/users/71f9c03c5c0b40ce81ea052befa2a06c/roles/31b3f11a82cd4cd2823e88aa0e931323 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:40:19.685362 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d87d3f-29af-4416-9160-99388480d60a None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:19.772502 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5feb38-1d36-4933-8fcd-d171fa9f4db4 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:19.792602 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d87d3f-29af-4416-9160-99388480d60a None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:19.809469 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f8655-ff70-4be5-b53d-fa950ff4ddb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:19.810299 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f8655-ff70-4be5-b53d-fa950ff4ddb0 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:19.810591 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f8655-ff70-4be5-b53d-fa950ff4ddb0 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:19.810869 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f8655-ff70-4be5-b53d-fa950ff4ddb0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:19.814400 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f8655-ff70-4be5-b53d-fa950ff4ddb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:19.814400 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f8655-ff70-4be5-b53d-fa950ff4ddb0 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:19.816652 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 24/44] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:40:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:19.821318 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f8655-ff70-4be5-b53d-fa950ff4ddb0 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:19.837479 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94f6f2-298d-4f5f-b54b-d06acc0bd187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:19.838170 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94f6f2-298d-4f5f-b54b-d06acc0bd187 None admin] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:19.838457 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94f6f2-298d-4f5f-b54b-d06acc0bd187 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:19.838736 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94f6f2-298d-4f5f-b54b-d06acc0bd187 None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:19.839495 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed94f6f2-298d-4f5f-b54b-d06acc0bd187 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:19.840943 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed94f6f2-298d-4f5f-b54b-d06acc0bd187 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:19.912678 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 21/45] 10.222.0.26 () {60 vars in 1131 bytes} [Sat Apr 30 20:40:19 2022] POST /identity/v3/roles => generated 223 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:40:19.927152 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f8655-ff70-4be5-b53d-fa950ff4ddb0 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:19.965919 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e5a3b-180e-4bb1-8159-0afc40dba2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:19.966602 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e5a3b-180e-4bb1-8159-0afc40dba2a7 None admin] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:19.966890 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e5a3b-180e-4bb1-8159-0afc40dba2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:19.967316 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e5a3b-180e-4bb1-8159-0afc40dba2a7 None admin] PATH_INFO: `/v3/projects` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:19.968103 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e5a3b-180e-4bb1-8159-0afc40dba2a7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:19.969678 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e5a3b-180e-4bb1-8159-0afc40dba2a7 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:20.080888 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 25/46] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Apr 30 20:40:19 2022] POST /identity/v3/projects => generated 312 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 20:40:22.005387 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60e9a2-0d98-4d64-8882-2f7f883ee50f None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:22.005898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60e9a2-0d98-4d64-8882-2f7f883ee50f None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:22.005979 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60e9a2-0d98-4d64-8882-2f7f883ee50f None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:22.007327 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 22/47] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:22.012733 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232926b-0ac8-49b4-8949-28dcd45e4523 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:22.013183 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232926b-0ac8-49b4-8949-28dcd45e4523 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:22.013357 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232926b-0ac8-49b4-8949-28dcd45e4523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:22.030497 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-f232926b-0ac8-49b4-8949-28dcd45e4523 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:22.031673 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-f232926b-0ac8-49b4-8949-28dcd45e4523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:22.096743 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 26/48] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:40:22.121419 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60e9a2-0d98-4d64-8882-2f7f883ee50f None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:22.225049 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60e9a2-0d98-4d64-8882-2f7f883ee50f None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:22.257237 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2737653-1f3b-4598-8e9f-de39ed43852f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:22.258036 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2737653-1f3b-4598-8e9f-de39ed43852f None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:22.258325 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2737653-1f3b-4598-8e9f-de39ed43852f None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:22.258608 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2737653-1f3b-4598-8e9f-de39ed43852f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:22.270525 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2737653-1f3b-4598-8e9f-de39ed43852f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:40:22.279256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-b2737653-1f3b-4598-8e9f-de39ed43852f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:40:22.279256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:40:22.279256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:40:22.279256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:40:22.279256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:40:22.279256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:40:22.279256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:40:22.279256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:40:22.279256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:40:22.279256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:40:22.279256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:40:22.279256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:40:22.279256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:40:22.279256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:40:22.279256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:40:22.279256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:40:22.280071 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:40:22.280071 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:40:22.280071 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:40:22.280071 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:40:22.280071 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:40:22.280071 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:40:22.280071 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:40:22.280071 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:40:22.280071 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:40:22.280071 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:40:22.280071 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:40:22.280071 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:40:22.280071 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:40:22.280071 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:40:22.280071 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:40:22.280071 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:40:22.280848 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:40:22.280848 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:40:22.280848 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:40:22.280848 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:40:22.280848 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:40:22.280848 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:40:22.280848 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:40:22.280848 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:40:22.280848 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:40:22.280848 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:40:22.280848 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:40:22.280848 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:40:22.280848 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 23/49] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Apr 30 20:40:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:40:22.286761 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232926b-0ac8-49b4-8949-28dcd45e4523 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:22.355938 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ffe26-98b3-42f7-a4aa-99871aa16462 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:22.356157 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ffe26-98b3-42f7-a4aa-99871aa16462 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:22.356440 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ffe26-98b3-42f7-a4aa-99871aa16462 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:22.357882 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 24/50] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:40:22.363014 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332f26f-4b2e-462c-abd9-b89c238e938f None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:22.363301 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332f26f-4b2e-462c-abd9-b89c238e938f None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:22.363580 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332f26f-4b2e-462c-abd9-b89c238e938f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:22.380668 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-6332f26f-4b2e-462c-abd9-b89c238e938f None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:22.382208 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-6332f26f-4b2e-462c-abd9-b89c238e938f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:22.384528 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232926b-0ac8-49b4-8949-28dcd45e4523 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:22.417408 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af69d62-e226-4213-929f-94d42f5f607e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:22.418067 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af69d62-e226-4213-929f-94d42f5f607e None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:22.418350 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af69d62-e226-4213-929f-94d42f5f607e None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:22.418624 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af69d62-e226-4213-929f-94d42f5f607e None admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:22.419355 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af69d62-e226-4213-929f-94d42f5f607e None admin] RBAC: Adding query filter params (name=admin) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:22.419661 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af69d62-e226-4213-929f-94d42f5f607e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:22.421065 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af69d62-e226-4213-929f-94d42f5f607e None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:22.428876 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 27/51] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:40:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:22.434380 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af69d62-e226-4213-929f-94d42f5f607e None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:22.446374 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 25/52] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:40:22.470521 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332f26f-4b2e-462c-abd9-b89c238e938f None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:22.530168 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af69d62-e226-4213-929f-94d42f5f607e None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:22.563384 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0025d15-b257-4e5d-af18-57820455ed6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:22.564260 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0025d15-b257-4e5d-af18-57820455ed6f None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:22.564543 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0025d15-b257-4e5d-af18-57820455ed6f None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:22.565686 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0025d15-b257-4e5d-af18-57820455ed6f None admin] PATH_INFO: `/v3/users/71f9c03c5c0b40ce81ea052befa2a06c` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:22.566892 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0025d15-b257-4e5d-af18-57820455ed6f None admin] RBAC: Authorizing `identity:get_user(user_id=71f9c03c5c0b40ce81ea052befa2a06c)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:22.568375 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0025d15-b257-4e5d-af18-57820455ed6f None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:22.569865 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332f26f-4b2e-462c-abd9-b89c238e938f None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:22.570280 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 28/53] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Apr 30 20:40:22 2022] GET /identity/v3/users/71f9c03c5c0b40ce81ea052befa2a06c => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:40:22.575525 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0025d15-b257-4e5d-af18-57820455ed6f None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:22.603426 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940ba10-6a22-48a0-87d6-70c90dfba4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:22.604223 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940ba10-6a22-48a0-87d6-70c90dfba4d7 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:22.604515 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940ba10-6a22-48a0-87d6-70c90dfba4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:22.604795 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940ba10-6a22-48a0-87d6-70c90dfba4d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:22.606075 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a940ba10-6a22-48a0-87d6-70c90dfba4d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:22.607488 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a940ba10-6a22-48a0-87d6-70c90dfba4d7 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:22.609125 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 26/54] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:40:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:40:22.615237 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940ba10-6a22-48a0-87d6-70c90dfba4d7 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:22.672873 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0025d15-b257-4e5d-af18-57820455ed6f None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:22.705517 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d28f28-6ba1-40c9-870d-a3e840c46f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:22.706472 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d28f28-6ba1-40c9-870d-a3e840c46f01 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:22.706763 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d28f28-6ba1-40c9-870d-a3e840c46f01 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:22.707037 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d28f28-6ba1-40c9-870d-a3e840c46f01 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:22.709709 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d28f28-6ba1-40c9-870d-a3e840c46f01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:22.709806 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940ba10-6a22-48a0-87d6-70c90dfba4d7 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:22.709892 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d28f28-6ba1-40c9-870d-a3e840c46f01 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:22.711694 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 29/55] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:40:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:40:22.717015 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d28f28-6ba1-40c9-870d-a3e840c46f01 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:22.743258 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf869437-82ba-4c1a-9671-161fe70409e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:22.743925 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf869437-82ba-4c1a-9671-161fe70409e8 None admin] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:22.744207 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf869437-82ba-4c1a-9671-161fe70409e8 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:22.744482 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf869437-82ba-4c1a-9671-161fe70409e8 None admin] PATH_INFO: `/v3/projects` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:22.745300 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf869437-82ba-4c1a-9671-161fe70409e8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:22.746733 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf869437-82ba-4c1a-9671-161fe70409e8 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:22.813631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d28f28-6ba1-40c9-870d-a3e840c46f01 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:22.827537 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 27/56] 10.222.0.26 () {60 vars in 1140 bytes} [Sat Apr 30 20:40:22 2022] POST /identity/v3/projects => generated 298 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 20:40:22.849531 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a251b6a-898a-4a38-a2e1-be2551450b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:22.850474 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a251b6a-898a-4a38-a2e1-be2551450b21 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:22.850762 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a251b6a-898a-4a38-a2e1-be2551450b21 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:22.851114 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a251b6a-898a-4a38-a2e1-be2551450b21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:22.851969 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a251b6a-898a-4a38-a2e1-be2551450b21 None admin] RBAC: Adding query filter params (role.id=31b3f11a82cd4cd2823e88aa0e931323, scope.domain.id=default, user.id=71f9c03c5c0b40ce81ea052befa2a06c) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:22.852288 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a251b6a-898a-4a38-a2e1-be2551450b21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:22.853830 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a251b6a-898a-4a38-a2e1-be2551450b21 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:22.866173 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 30/57] 10.222.0.26 () {56 vars in 1322 bytes} [Sat Apr 30 20:40:22 2022] GET /identity/v3/role_assignments?user.id=71f9c03c5c0b40ce81ea052befa2a06c&scope.domain.id=default&role.id=31b3f11a82cd4cd2823e88aa0e931323 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:40:25.131305 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de59803-a342-4e09-814c-cdea34e2f283 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:25.131792 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de59803-a342-4e09-814c-cdea34e2f283 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:25.131792 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de59803-a342-4e09-814c-cdea34e2f283 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:25.133178 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 28/58] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:25.138361 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49d7a2-c053-4ed1-82ee-a7b055b695da None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:25.138768 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49d7a2-c053-4ed1-82ee-a7b055b695da None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:25.138930 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49d7a2-c053-4ed1-82ee-a7b055b695da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:25.155757 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-6a49d7a2-c053-4ed1-82ee-a7b055b695da None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:25.156959 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-6a49d7a2-c053-4ed1-82ee-a7b055b695da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:25.220632 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 31/59] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:40:25.246713 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de59803-a342-4e09-814c-cdea34e2f283 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:25.354201 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de59803-a342-4e09-814c-cdea34e2f283 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:25.394734 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be3ea67-75e3-42f6-bc4c-041a72659dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:25.394734 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3ea67-75e3-42f6-bc4c-041a72659dfc None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:25.394734 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3ea67-75e3-42f6-bc4c-041a72659dfc None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:25.394734 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3ea67-75e3-42f6-bc4c-041a72659dfc None admin] PATH_INFO: `/v3/domains/default` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:25.395131 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be3ea67-75e3-42f6-bc4c-041a72659dfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:25.395131 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be3ea67-75e3-42f6-bc4c-041a72659dfc None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:25.395131 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 29/60] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:40:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:25.397735 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49d7a2-c053-4ed1-82ee-a7b055b695da None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:25.491101 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49d7a2-c053-4ed1-82ee-a7b055b695da None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:25.523828 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c58472-bae9-4703-9aa7-d0829d95d001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:25.524490 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c58472-bae9-4703-9aa7-d0829d95d001 None admin] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:25.524776 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c58472-bae9-4703-9aa7-d0829d95d001 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:25.525086 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c58472-bae9-4703-9aa7-d0829d95d001 None admin] PATH_INFO: `/v3/users` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:25.525801 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c58472-bae9-4703-9aa7-d0829d95d001 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:25.527276 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c58472-bae9-4703-9aa7-d0829d95d001 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:25.614736 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 32/61] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Apr 30 20:40:25 2022] POST /identity/v3/users => generated 275 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:40:29.124748 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e01d7-7447-4a26-88bd-33284fe1b0a7 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:29.125342 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e01d7-7447-4a26-88bd-33284fe1b0a7 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:29.125342 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e01d7-7447-4a26-88bd-33284fe1b0a7 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:29.126907 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 30/62] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:29.133106 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c6743-4a17-4443-84a2-4d75e5e345ec None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:29.163159 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c6743-4a17-4443-84a2-4d75e5e345ec None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:29.163159 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c6743-4a17-4443-84a2-4d75e5e345ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:29.163159 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-c11c6743-4a17-4443-84a2-4d75e5e345ec None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:29.163159 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-c11c6743-4a17-4443-84a2-4d75e5e345ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:29.229035 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 33/63] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:40:29.249180 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e01d7-7447-4a26-88bd-33284fe1b0a7 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:29.329325 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6c3bc-cd94-4187-8d9e-fd764fce73f7 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:29.329659 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6c3bc-cd94-4187-8d9e-fd764fce73f7 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:29.329902 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6c3bc-cd94-4187-8d9e-fd764fce73f7 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:29.334088 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 34/64] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:40:29.341513 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff18ad3-8d24-4272-bfd9-d9bf6a755937 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:29.341863 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff18ad3-8d24-4272-bfd9-d9bf6a755937 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:29.342086 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff18ad3-8d24-4272-bfd9-d9bf6a755937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:29.382087 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-2ff18ad3-8d24-4272-bfd9-d9bf6a755937 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:29.383021 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e01d7-7447-4a26-88bd-33284fe1b0a7 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:29.383213 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-2ff18ad3-8d24-4272-bfd9-d9bf6a755937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:29.418641 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9732c6-c84e-46ae-ae54-3bb587dc2faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:29.419898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9732c6-c84e-46ae-ae54-3bb587dc2faf None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:29.420402 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9732c6-c84e-46ae-ae54-3bb587dc2faf None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:29.420891 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9732c6-c84e-46ae-ae54-3bb587dc2faf None admin] PATH_INFO: `/v3/roles/member` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:29.432005 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9732c6-c84e-46ae-ae54-3bb587dc2faf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:40:29.441491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-4e9732c6-c84e-46ae-ae54-3bb587dc2faf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:40:29.441491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:40:29.441491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:40:29.441491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:40:29.441491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:40:29.441491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:40:29.441491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:40:29.441491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:40:29.441491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:40:29.441491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:40:29.441491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:40:29.441491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:40:29.441491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:40:29.441491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:40:29.441491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:40:29.441491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:40:29.442394 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:40:29.442394 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:40:29.442394 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:40:29.442394 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:40:29.442394 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:40:29.442394 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:40:29.442394 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:40:29.442394 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:40:29.442394 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:40:29.442394 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:40:29.442394 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:40:29.442394 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:40:29.442394 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:40:29.442394 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:40:29.442394 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:40:29.442394 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:40:29.443198 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:40:29.443198 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:40:29.443198 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:40:29.443198 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:40:29.443198 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:40:29.443198 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:40:29.443198 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:40:29.443198 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:40:29.443198 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:40:29.443198 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:40:29.443198 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:40:29.443198 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:40:29.445649 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 31/65] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:40:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:40:29.457968 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9732c6-c84e-46ae-ae54-3bb587dc2faf None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:29.503520 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 35/66] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:40:29.504876 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec23810-e46c-4e41-ac89-4237cc348033 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:29.505196 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec23810-e46c-4e41-ac89-4237cc348033 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:29.505477 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec23810-e46c-4e41-ac89-4237cc348033 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:29.506872 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 36/67] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:29.512146 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bf4b0-e3e6-4071-a927-108ea84251a7 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:29.512442 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bf4b0-e3e6-4071-a927-108ea84251a7 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:29.512727 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bf4b0-e3e6-4071-a927-108ea84251a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:29.531787 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-e79bf4b0-e3e6-4071-a927-108ea84251a7 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:29.535089 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-e79bf4b0-e3e6-4071-a927-108ea84251a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:29.610825 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9732c6-c84e-46ae-ae54-3bb587dc2faf None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:29.617833 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 37/68] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:40:29.621378 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bf4b0-e3e6-4071-a927-108ea84251a7 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:29.669777 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aba49a-cffd-4ac4-8c2a-180fed750570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:29.670536 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aba49a-cffd-4ac4-8c2a-180fed750570 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:29.670822 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aba49a-cffd-4ac4-8c2a-180fed750570 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:29.671884 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aba49a-cffd-4ac4-8c2a-180fed750570 None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:29.672648 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aba49a-cffd-4ac4-8c2a-180fed750570 None admin] RBAC: Adding query filter params (name=member) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:29.672978 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aba49a-cffd-4ac4-8c2a-180fed750570 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:29.674416 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aba49a-cffd-4ac4-8c2a-180fed750570 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:29.688978 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 32/69] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Apr 30 20:40:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:29.690276 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aba49a-cffd-4ac4-8c2a-180fed750570 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:29.749364 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bf4b0-e3e6-4071-a927-108ea84251a7 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:29.790748 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe4a62-ce95-4d74-b4bf-7bdb8c4981c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:29.791732 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe4a62-ce95-4d74-b4bf-7bdb8c4981c7 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:29.792025 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe4a62-ce95-4d74-b4bf-7bdb8c4981c7 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:29.792668 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe4a62-ce95-4d74-b4bf-7bdb8c4981c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:29.807517 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe4a62-ce95-4d74-b4bf-7bdb8c4981c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:40:29.810723 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aba49a-cffd-4ac4-8c2a-180fed750570 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:29.817837 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-cdbe4a62-ce95-4d74-b4bf-7bdb8c4981c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:40:29.817837 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:40:29.817837 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:40:29.817837 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:40:29.817837 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:40:29.817837 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:40:29.817837 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:40:29.817837 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:40:29.817837 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:40:29.817837 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:40:29.817837 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:40:29.817837 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:40:29.817837 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:40:29.817837 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:40:29.817837 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:40:29.817837 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:40:29.818693 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:40:29.818693 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:40:29.818693 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:40:29.818693 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:40:29.818693 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:40:29.818693 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:40:29.818693 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:40:29.818693 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:40:29.818693 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:40:29.818693 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:40:29.818693 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:40:29.818693 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:40:29.818693 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:40:29.818693 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:40:29.818693 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:40:29.818693 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:40:29.819457 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:40:29.819457 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:40:29.819457 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:40:29.819457 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:40:29.819457 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:40:29.819457 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:40:29.819457 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:40:29.819457 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:40:29.819457 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:40:29.819457 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:40:29.819457 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:40:29.819457 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:40:29.820024 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 38/70] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Apr 30 20:40:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:40:29.820706 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe4a62-ce95-4d74-b4bf-7bdb8c4981c7 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:29.846121 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793262e1-0826-4e89-a3be-81b1dc444285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:29.846937 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793262e1-0826-4e89-a3be-81b1dc444285 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:29.847219 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793262e1-0826-4e89-a3be-81b1dc444285 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:29.847498 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793262e1-0826-4e89-a3be-81b1dc444285 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:29.858448 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793262e1-0826-4e89-a3be-81b1dc444285 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:40:29.867273 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-793262e1-0826-4e89-a3be-81b1dc444285 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:40:29.867273 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:40:29.867273 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:40:29.867273 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:40:29.867273 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:40:29.867273 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:40:29.867273 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:40:29.867273 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:40:29.867273 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:40:29.867273 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:40:29.867273 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:40:29.867273 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:40:29.867273 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:40:29.867273 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:40:29.867273 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:40:29.867273 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:40:29.868125 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:40:29.868125 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:40:29.868125 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:40:29.868125 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:40:29.868125 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:40:29.868125 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:40:29.868125 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:40:29.868125 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:40:29.868125 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:40:29.868125 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:40:29.868125 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:40:29.868125 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:40:29.868125 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:40:29.868125 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:40:29.868125 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:40:29.868125 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:40:29.870217 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:40:29.870217 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:40:29.870217 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:40:29.870217 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:40:29.870217 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:40:29.870217 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:40:29.870217 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:40:29.870217 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:40:29.870217 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:40:29.870217 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:40:29.870217 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:40:29.870217 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:40:29.870217 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 33/71] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Apr 30 20:40:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:40:29.876937 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793262e1-0826-4e89-a3be-81b1dc444285 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:29.945763 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe4a62-ce95-4d74-b4bf-7bdb8c4981c7 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:29.979726 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793262e1-0826-4e89-a3be-81b1dc444285 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:29.984112 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57273f-dfe6-4c8f-bb10-247339dad588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:29.985038 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57273f-dfe6-4c8f-bb10-247339dad588 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:29.985333 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57273f-dfe6-4c8f-bb10-247339dad588 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:29.985616 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57273f-dfe6-4c8f-bb10-247339dad588 None admin] PATH_INFO: `/v3/users/cecfe9bf486c4fba9525c86babed4c07` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:29.999556 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57273f-dfe6-4c8f-bb10-247339dad588 None admin] RBAC: Authorizing `identity:get_user(user_id=cecfe9bf486c4fba9525c86babed4c07)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:30.001078 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57273f-dfe6-4c8f-bb10-247339dad588 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:30.002821 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 39/72] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Apr 30 20:40:29 2022] GET /identity/v3/users/cecfe9bf486c4fba9525c86babed4c07 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:30.003591 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57273f-dfe6-4c8f-bb10-247339dad588 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:30.012541 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d99fb-6642-40da-b121-81c62117c5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:30.013237 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d99fb-6642-40da-b121-81c62117c5e7 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:30.013524 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d99fb-6642-40da-b121-81c62117c5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:30.013800 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d99fb-6642-40da-b121-81c62117c5e7 None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:30.014536 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d99fb-6642-40da-b121-81c62117c5e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:30.014843 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d99fb-6642-40da-b121-81c62117c5e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:30.016228 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d99fb-6642-40da-b121-81c62117c5e7 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:30.024084 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 34/73] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:40:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:30.025317 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592ea78-1b48-4833-89ca-d8e9e6e4863b None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:30.025611 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592ea78-1b48-4833-89ca-d8e9e6e4863b None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:30.026007 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592ea78-1b48-4833-89ca-d8e9e6e4863b None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:30.028868 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 35/74] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:30.028868 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05527cba-072c-4915-b2fc-f98cef4cca5f None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:30.028868 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05527cba-072c-4915-b2fc-f98cef4cca5f None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:30.029184 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05527cba-072c-4915-b2fc-f98cef4cca5f None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:30.030501 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 36/75] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:30.031038 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05527cba-072c-4915-b2fc-f98cef4cca5f None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:30.100631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57273f-dfe6-4c8f-bb10-247339dad588 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:30.129252 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05527cba-072c-4915-b2fc-f98cef4cca5f None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:30.133483 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9f361-eecf-4036-ae4a-2d2be08dc3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:30.134158 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9f361-eecf-4036-ae4a-2d2be08dc3c0 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:30.134443 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9f361-eecf-4036-ae4a-2d2be08dc3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:30.134721 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9f361-eecf-4036-ae4a-2d2be08dc3c0 None admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:30.135462 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9f361-eecf-4036-ae4a-2d2be08dc3c0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:30.135779 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9f361-eecf-4036-ae4a-2d2be08dc3c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:30.137211 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9f361-eecf-4036-ae4a-2d2be08dc3c0 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:30.144982 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 40/76] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:40:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:30.149566 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9f361-eecf-4036-ae4a-2d2be08dc3c0 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:30.161987 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c0da9-fe9e-448d-bdcb-e4723cd547d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:30.162640 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c0da9-fe9e-448d-bdcb-e4723cd547d6 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:30.162925 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c0da9-fe9e-448d-bdcb-e4723cd547d6 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:30.163204 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c0da9-fe9e-448d-bdcb-e4723cd547d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:30.227467 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c0da9-fe9e-448d-bdcb-e4723cd547d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:30.228869 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c0da9-fe9e-448d-bdcb-e4723cd547d6 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:30.244553 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9f361-eecf-4036-ae4a-2d2be08dc3c0 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:30.276799 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c64608-4fe2-4b0a-b2dc-f5e1223100d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:30.277721 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c64608-4fe2-4b0a-b2dc-f5e1223100d0 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:30.278006 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c64608-4fe2-4b0a-b2dc-f5e1223100d0 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:30.278290 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c64608-4fe2-4b0a-b2dc-f5e1223100d0 None admin] PATH_INFO: `/v3/users/71f9c03c5c0b40ce81ea052befa2a06c` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:30.279464 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c64608-4fe2-4b0a-b2dc-f5e1223100d0 None admin] RBAC: Authorizing `identity:get_user(user_id=71f9c03c5c0b40ce81ea052befa2a06c)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:30.280928 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c64608-4fe2-4b0a-b2dc-f5e1223100d0 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:30.282589 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 41/77] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Apr 30 20:40:30 2022] GET /identity/v3/users/71f9c03c5c0b40ce81ea052befa2a06c => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:30.284574 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea761be9-a21b-4964-95f6-6b5c86ffef46 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:30.284862 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea761be9-a21b-4964-95f6-6b5c86ffef46 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:30.285159 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea761be9-a21b-4964-95f6-6b5c86ffef46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:30.300977 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-ea761be9-a21b-4964-95f6-6b5c86ffef46 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:30.302173 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-ea761be9-a21b-4964-95f6-6b5c86ffef46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:30.321821 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 37/78] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:40:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:40:30.323091 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4655be-71da-40c3-a5b5-7648d59b775b None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:30.323381 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4655be-71da-40c3-a5b5-7648d59b775b None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:30.323659 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4655be-71da-40c3-a5b5-7648d59b775b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:30.340427 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-ce4655be-71da-40c3-a5b5-7648d59b775b None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:30.341656 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-ce4655be-71da-40c3-a5b5-7648d59b775b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:30.366358 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 42/79] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:40:30.367202 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea761be9-a21b-4964-95f6-6b5c86ffef46 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:30.412951 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 38/80] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:40:30.412951 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4655be-71da-40c3-a5b5-7648d59b775b None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:30.463686 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea761be9-a21b-4964-95f6-6b5c86ffef46 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:30.496713 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc8f7a-2b49-49bd-9de3-a950b0495055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:30.502634 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc8f7a-2b49-49bd-9de3-a950b0495055 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:30.502634 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc8f7a-2b49-49bd-9de3-a950b0495055 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:30.502634 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc8f7a-2b49-49bd-9de3-a950b0495055 None admin] PATH_INFO: `/v3/users/cecfe9bf486c4fba9525c86babed4c07` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:30.502634 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc8f7a-2b49-49bd-9de3-a950b0495055 None admin] RBAC: Authorizing `identity:get_user(user_id=cecfe9bf486c4fba9525c86babed4c07)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:30.502634 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc8f7a-2b49-49bd-9de3-a950b0495055 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:30.503321 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4655be-71da-40c3-a5b5-7648d59b775b None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:30.503475 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 43/81] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Apr 30 20:40:30 2022] GET /identity/v3/users/cecfe9bf486c4fba9525c86babed4c07 => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:30.504308 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc8f7a-2b49-49bd-9de3-a950b0495055 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:30.537456 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20e031-8083-4342-84d0-0cd4d4320fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:30.538096 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20e031-8083-4342-84d0-0cd4d4320fc0 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:30.538379 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20e031-8083-4342-84d0-0cd4d4320fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:30.538660 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20e031-8083-4342-84d0-0cd4d4320fc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:30.601375 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc8f7a-2b49-49bd-9de3-a950b0495055 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:30.602666 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20e031-8083-4342-84d0-0cd4d4320fc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:30.604128 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20e031-8083-4342-84d0-0cd4d4320fc0 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:30.633891 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b136e-2a2a-4079-ab4f-7cf73928e9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:30.634743 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b136e-2a2a-4079-ab4f-7cf73928e9b4 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:30.635023 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b136e-2a2a-4079-ab4f-7cf73928e9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:30.635300 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b136e-2a2a-4079-ab4f-7cf73928e9b4 None admin] PATH_INFO: `/v3/projects/b65984e2c7ae400c829003b7ab39d8e2` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:30.636472 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b136e-2a2a-4079-ab4f-7cf73928e9b4 None admin] RBAC: Authorizing `identity:get_project(project_id=b65984e2c7ae400c829003b7ab39d8e2)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:30.637945 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b136e-2a2a-4079-ab4f-7cf73928e9b4 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:30.639629 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 44/82] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:40:30 2022] GET /identity/v3/projects/b65984e2c7ae400c829003b7ab39d8e2 => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:30.640383 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b136e-2a2a-4079-ab4f-7cf73928e9b4 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:30.696720 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 39/83] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:40:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:40:30.697791 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20e031-8083-4342-84d0-0cd4d4320fc0 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:30.734610 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b136e-2a2a-4079-ab4f-7cf73928e9b4 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:30.766335 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546e841-1721-4e05-9cd5-f50d44399a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:30.767116 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546e841-1721-4e05-9cd5-f50d44399a3a None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:30.767395 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546e841-1721-4e05-9cd5-f50d44399a3a None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:30.767689 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546e841-1721-4e05-9cd5-f50d44399a3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:30.769382 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546e841-1721-4e05-9cd5-f50d44399a3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:30.770850 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546e841-1721-4e05-9cd5-f50d44399a3a None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:30.772454 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 45/84] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:40:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:30.772454 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546e841-1721-4e05-9cd5-f50d44399a3a None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:30.794886 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20e031-8083-4342-84d0-0cd4d4320fc0 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:30.828315 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3f6c0-1edd-40e0-a284-4cf79899d278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:30.829149 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3f6c0-1edd-40e0-a284-4cf79899d278 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:30.829431 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3f6c0-1edd-40e0-a284-4cf79899d278 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:30.829705 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3f6c0-1edd-40e0-a284-4cf79899d278 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:30.839799 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3f6c0-1edd-40e0-a284-4cf79899d278 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:40:30.847459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-dcd3f6c0-1edd-40e0-a284-4cf79899d278 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:40:30.847459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:40:30.847459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:40:30.847459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:40:30.847459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:40:30.847459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:40:30.847459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:40:30.847459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:40:30.847459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:40:30.847459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:40:30.847459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:40:30.847459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:40:30.847459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:40:30.847459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:40:30.847459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:40:30.847459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:40:30.848306 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:40:30.848306 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:40:30.848306 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:40:30.848306 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:40:30.848306 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:40:30.848306 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:40:30.848306 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:40:30.848306 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:40:30.848306 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:40:30.848306 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:40:30.848306 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:40:30.848306 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:40:30.848306 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:40:30.848306 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:40:30.848306 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:40:30.848306 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:40:30.849114 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:40:30.849114 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:40:30.849114 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:40:30.849114 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:40:30.849114 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:40:30.849114 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:40:30.849114 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:40:30.849114 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:40:30.849114 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:40:30.849114 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:40:30.849114 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:40:30.849114 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:40:30.849114 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 40/85] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:40:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:40:30.849773 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3f6c0-1edd-40e0-a284-4cf79899d278 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:30.869270 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546e841-1721-4e05-9cd5-f50d44399a3a None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:30.902639 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf11a1-8dce-4db4-8c8b-12756df5c83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:30.903277 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf11a1-8dce-4db4-8c8b-12756df5c83b None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:30.903557 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf11a1-8dce-4db4-8c8b-12756df5c83b None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:30.903834 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf11a1-8dce-4db4-8c8b-12756df5c83b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:30.944179 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3f6c0-1edd-40e0-a284-4cf79899d278 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:30.968484 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf11a1-8dce-4db4-8c8b-12756df5c83b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:30.970038 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf11a1-8dce-4db4-8c8b-12756df5c83b None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:30.976019 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130b561-29d0-48bd-86ba-cf58885c5521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:30.976670 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130b561-29d0-48bd-86ba-cf58885c5521 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:30.976975 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130b561-29d0-48bd-86ba-cf58885c5521 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:30.977251 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130b561-29d0-48bd-86ba-cf58885c5521 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:30.978071 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130b561-29d0-48bd-86ba-cf58885c5521 None admin] RBAC: Adding query filter params (role.id=375abc9f701c408ea332eaf2d8a2e086, scope.project.id=b65984e2c7ae400c829003b7ab39d8e2, user.id=cecfe9bf486c4fba9525c86babed4c07) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:30.978381 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130b561-29d0-48bd-86ba-cf58885c5521 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:30.979813 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130b561-29d0-48bd-86ba-cf58885c5521 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:30.987247 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 41/86] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Apr 30 20:40:30 2022] GET /identity/v3/role_assignments?user.id=cecfe9bf486c4fba9525c86babed4c07&scope.project.id=b65984e2c7ae400c829003b7ab39d8e2&role.id=375abc9f701c408ea332eaf2d8a2e086 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:30.988026 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130b561-29d0-48bd-86ba-cf58885c5521 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:31.074435 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 46/87] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:40:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:40:31.075509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf11a1-8dce-4db4-8c8b-12756df5c83b None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:31.108464 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130b561-29d0-48bd-86ba-cf58885c5521 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:31.149847 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b453e-ccc7-4a31-b5c8-9131dc7b32d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:31.150734 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b453e-ccc7-4a31-b5c8-9131dc7b32d6 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:31.151019 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b453e-ccc7-4a31-b5c8-9131dc7b32d6 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:31.151297 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b453e-ccc7-4a31-b5c8-9131dc7b32d6 None admin] PATH_INFO: `/v3/projects/b65984e2c7ae400c829003b7ab39d8e2` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:31.152552 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b453e-ccc7-4a31-b5c8-9131dc7b32d6 None admin] RBAC: Authorizing `identity:get_project(project_id=b65984e2c7ae400c829003b7ab39d8e2)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:31.154366 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b453e-ccc7-4a31-b5c8-9131dc7b32d6 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:31.162434 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 42/88] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:40:30 2022] GET /identity/v3/projects/b65984e2c7ae400c829003b7ab39d8e2 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:31.162434 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b453e-ccc7-4a31-b5c8-9131dc7b32d6 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:31.181434 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf11a1-8dce-4db4-8c8b-12756df5c83b None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:31.216729 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7ca52-1f9e-4b1e-97a0-ddc53567d90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:31.217480 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7ca52-1f9e-4b1e-97a0-ddc53567d90b None admin] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:31.217772 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7ca52-1f9e-4b1e-97a0-ddc53567d90b None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:31.218025 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7ca52-1f9e-4b1e-97a0-ddc53567d90b None admin] PATH_INFO: `/v3/users` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:31.218718 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7ca52-1f9e-4b1e-97a0-ddc53567d90b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:31.220176 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7ca52-1f9e-4b1e-97a0-ddc53567d90b None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:31.257586 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b453e-ccc7-4a31-b5c8-9131dc7b32d6 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:31.283629 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 47/89] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Apr 30 20:40:31 2022] POST /identity/v3/users => generated 289 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:40:31.284671 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7ca52-1f9e-4b1e-97a0-ddc53567d90b None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:31.301742 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8354a-ca17-482b-b95a-4206b9415538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:31.302501 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8354a-ca17-482b-b95a-4206b9415538 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:31.302837 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8354a-ca17-482b-b95a-4206b9415538 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:31.303123 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8354a-ca17-482b-b95a-4206b9415538 None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:31.303899 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8354a-ca17-482b-b95a-4206b9415538 None admin] RBAC: Adding query filter params (name=member) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:31.304233 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8354a-ca17-482b-b95a-4206b9415538 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:31.306507 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8354a-ca17-482b-b95a-4206b9415538 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:31.317431 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 43/90] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Apr 30 20:40:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:31.318395 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8354a-ca17-482b-b95a-4206b9415538 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:31.422532 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7ca52-1f9e-4b1e-97a0-ddc53567d90b None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:31.452102 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8354a-ca17-482b-b95a-4206b9415538 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:31.463130 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f928d0-1d84-4d01-a590-c0b545008e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:31.464398 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f928d0-1d84-4d01-a590-c0b545008e77 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:31.464684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f928d0-1d84-4d01-a590-c0b545008e77 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:31.464988 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f928d0-1d84-4d01-a590-c0b545008e77 None admin] PATH_INFO: `/v3/projects/b65984e2c7ae400c829003b7ab39d8e2` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:31.466817 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f928d0-1d84-4d01-a590-c0b545008e77 None admin] RBAC: Authorizing `identity:get_project(project_id=b65984e2c7ae400c829003b7ab39d8e2)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:31.468486 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f928d0-1d84-4d01-a590-c0b545008e77 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:31.471635 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 48/91] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:40:31 2022] GET /identity/v3/projects/b65984e2c7ae400c829003b7ab39d8e2 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:31.472506 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f928d0-1d84-4d01-a590-c0b545008e77 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:31.500997 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215f743-b9fc-4277-9297-c7153a0a528b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:31.501699 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215f743-b9fc-4277-9297-c7153a0a528b None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:31.501988 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215f743-b9fc-4277-9297-c7153a0a528b None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:31.502463 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215f743-b9fc-4277-9297-c7153a0a528b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:31.503132 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b215f743-b9fc-4277-9297-c7153a0a528b None admin] RBAC: Adding query filter params (role.id=31b3f11a82cd4cd2823e88aa0e931323, scope.project.id=b65984e2c7ae400c829003b7ab39d8e2, user.id=71f9c03c5c0b40ce81ea052befa2a06c) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:31.503466 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b215f743-b9fc-4277-9297-c7153a0a528b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:31.504971 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b215f743-b9fc-4277-9297-c7153a0a528b None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:31.511417 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 44/92] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Apr 30 20:40:31 2022] GET /identity/v3/role_assignments?user.id=71f9c03c5c0b40ce81ea052befa2a06c&scope.project.id=b65984e2c7ae400c829003b7ab39d8e2&role.id=31b3f11a82cd4cd2823e88aa0e931323 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:31.512232 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215f743-b9fc-4277-9297-c7153a0a528b None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:31.613533 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f928d0-1d84-4d01-a590-c0b545008e77 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:31.639973 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215f743-b9fc-4277-9297-c7153a0a528b None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:31.659794 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f6e12-3d1a-4567-9eb0-3563395800dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:31.660703 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f6e12-3d1a-4567-9eb0-3563395800dc None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:31.661040 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f6e12-3d1a-4567-9eb0-3563395800dc None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:31.661327 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f6e12-3d1a-4567-9eb0-3563395800dc None admin] PATH_INFO: `/v3/users/cecfe9bf486c4fba9525c86babed4c07` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:31.662693 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f6e12-3d1a-4567-9eb0-3563395800dc None admin] RBAC: Authorizing `identity:get_user(user_id=cecfe9bf486c4fba9525c86babed4c07)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:31.665335 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f6e12-3d1a-4567-9eb0-3563395800dc None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:31.666141 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 49/93] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Apr 30 20:40:31 2022] GET /identity/v3/users/cecfe9bf486c4fba9525c86babed4c07 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:31.671834 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f6e12-3d1a-4567-9eb0-3563395800dc None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:31.693034 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea9799-13a0-42d3-b681-f9ba6282eee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:31.693034 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea9799-13a0-42d3-b681-f9ba6282eee9 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:31.693034 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea9799-13a0-42d3-b681-f9ba6282eee9 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:31.693034 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea9799-13a0-42d3-b681-f9ba6282eee9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:31.693593 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea9799-13a0-42d3-b681-f9ba6282eee9 None admin] RBAC: Adding query filter params (role.id=f76bb9b1c47a4fbfa232de16b0b4a0d5, scope.project.id=b65984e2c7ae400c829003b7ab39d8e2, user.id=cecfe9bf486c4fba9525c86babed4c07) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:31.693593 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea9799-13a0-42d3-b681-f9ba6282eee9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:31.694837 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea9799-13a0-42d3-b681-f9ba6282eee9 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:31.704514 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 45/94] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Apr 30 20:40:31 2022] GET /identity/v3/role_assignments?user.id=cecfe9bf486c4fba9525c86babed4c07&scope.project.id=b65984e2c7ae400c829003b7ab39d8e2&role.id=f76bb9b1c47a4fbfa232de16b0b4a0d5 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:31.813206 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f6e12-3d1a-4567-9eb0-3563395800dc None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:31.857086 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a63eb-1e91-4916-895c-3e255d3dd5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:31.857773 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a63eb-1e91-4916-895c-3e255d3dd5d0 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:31.858063 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a63eb-1e91-4916-895c-3e255d3dd5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:31.858348 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a63eb-1e91-4916-895c-3e255d3dd5d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:31.940954 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a63eb-1e91-4916-895c-3e255d3dd5d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:31.942801 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a63eb-1e91-4916-895c-3e255d3dd5d0 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:32.059380 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 50/95] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:40:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 30 20:40:32.067942 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea9799-13a0-42d3-b681-f9ba6282eee9 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:32.201223 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea9799-13a0-42d3-b681-f9ba6282eee9 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:32.240561 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace9851-b5d3-4578-a1bc-d75383542f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:32.241462 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace9851-b5d3-4578-a1bc-d75383542f66 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:32.241744 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace9851-b5d3-4578-a1bc-d75383542f66 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:32.242019 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace9851-b5d3-4578-a1bc-d75383542f66 None admin] PATH_INFO: `/v3/projects/4972609a22ba4b78bd1a06cf5b0712e2` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:32.243230 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace9851-b5d3-4578-a1bc-d75383542f66 None admin] RBAC: Authorizing `identity:get_project(project_id=4972609a22ba4b78bd1a06cf5b0712e2)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:32.244697 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace9851-b5d3-4578-a1bc-d75383542f66 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:32.246440 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 46/96] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:40:32 2022] GET /identity/v3/projects/4972609a22ba4b78bd1a06cf5b0712e2 => generated 312 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:32.252572 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a63eb-1e91-4916-895c-3e255d3dd5d0 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:32.391301 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a63eb-1e91-4916-895c-3e255d3dd5d0 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:32.432429 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6e001-15d3-45e3-b107-9731dd113fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:32.433488 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6e001-15d3-45e3-b107-9731dd113fe6 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:32.433971 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6e001-15d3-45e3-b107-9731dd113fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:32.434445 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6e001-15d3-45e3-b107-9731dd113fe6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:32.435468 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6e001-15d3-45e3-b107-9731dd113fe6 None admin] RBAC: Adding query filter params (role.id=375abc9f701c408ea332eaf2d8a2e086, scope.project.id=4972609a22ba4b78bd1a06cf5b0712e2, user.id=cecfe9bf486c4fba9525c86babed4c07) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:32.435984 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6e001-15d3-45e3-b107-9731dd113fe6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:32.437840 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6e001-15d3-45e3-b107-9731dd113fe6 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:32.444059 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 51/97] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Apr 30 20:40:32 2022] GET /identity/v3/role_assignments?user.id=cecfe9bf486c4fba9525c86babed4c07&scope.project.id=4972609a22ba4b78bd1a06cf5b0712e2&role.id=375abc9f701c408ea332eaf2d8a2e086 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:33.938953 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d33421-a663-484d-a521-a33d41d3f8dc None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:33.939484 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d33421-a663-484d-a521-a33d41d3f8dc None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:33.939484 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d33421-a663-484d-a521-a33d41d3f8dc None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:33.941429 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 47/98] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:33.947044 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805a6ef-de99-4dd7-b9ec-42ae8b661784 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:33.947449 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805a6ef-de99-4dd7-b9ec-42ae8b661784 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:33.947635 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805a6ef-de99-4dd7-b9ec-42ae8b661784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:33.974329 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-e805a6ef-de99-4dd7-b9ec-42ae8b661784 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:33.975781 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-e805a6ef-de99-4dd7-b9ec-42ae8b661784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:34.063454 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 52/99] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:40:34.112133 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d33421-a663-484d-a521-a33d41d3f8dc None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:34.230170 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d33421-a663-484d-a521-a33d41d3f8dc None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:34.284765 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986382d-bc9c-4f70-bf87-1a0c019fd3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:34.285877 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986382d-bc9c-4f70-bf87-1a0c019fd3ca None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:34.286161 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986382d-bc9c-4f70-bf87-1a0c019fd3ca None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:34.286444 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986382d-bc9c-4f70-bf87-1a0c019fd3ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:34.304552 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986382d-bc9c-4f70-bf87-1a0c019fd3ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:40:34.312198 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-9986382d-bc9c-4f70-bf87-1a0c019fd3ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:40:34.312198 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:40:34.312198 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:40:34.312198 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:40:34.312198 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:40:34.312198 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:40:34.312198 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:40:34.312198 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:40:34.312198 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:40:34.312198 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:40:34.312198 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:40:34.312198 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:40:34.312198 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:40:34.312198 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:40:34.312198 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:40:34.312198 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:40:34.313136 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:40:34.313136 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:40:34.313136 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:40:34.313136 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:40:34.313136 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:40:34.313136 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:40:34.313136 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:40:34.313136 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:40:34.313136 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:40:34.313136 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:40:34.313136 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:40:34.313136 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:40:34.313136 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:40:34.313136 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:40:34.313136 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:40:34.313136 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:40:34.313898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:40:34.313898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:40:34.313898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:40:34.313898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:40:34.313898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:40:34.313898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:40:34.313898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:40:34.313898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:40:34.313898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:40:34.313898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:40:34.313898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:40:34.313898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:40:34.317734 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 48/100] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:40:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:40:34.323729 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805a6ef-de99-4dd7-b9ec-42ae8b661784 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:34.458511 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805a6ef-de99-4dd7-b9ec-42ae8b661784 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:34.496372 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec207f-0993-457c-aefd-e7bfa93d8994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:34.497078 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec207f-0993-457c-aefd-e7bfa93d8994 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:34.497362 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec207f-0993-457c-aefd-e7bfa93d8994 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:34.497637 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec207f-0993-457c-aefd-e7bfa93d8994 None admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:34.498388 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec207f-0993-457c-aefd-e7bfa93d8994 None admin] RBAC: Adding query filter params (name=member) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:34.498694 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec207f-0993-457c-aefd-e7bfa93d8994 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:34.500086 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec207f-0993-457c-aefd-e7bfa93d8994 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:34.511638 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 53/101] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Apr 30 20:40:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:34.526142 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986382d-bc9c-4f70-bf87-1a0c019fd3ca None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:34.528328 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26acf2-afe6-4747-bb92-7b95d6c99982 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:34.528550 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26acf2-afe6-4747-bb92-7b95d6c99982 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:34.528783 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26acf2-afe6-4747-bb92-7b95d6c99982 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:34.530298 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 54/102] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:40:34.538572 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa3139-5e50-417c-a784-12bf78aacca8 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:34.538857 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa3139-5e50-417c-a784-12bf78aacca8 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:34.539132 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa3139-5e50-417c-a784-12bf78aacca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:34.662219 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-88aa3139-5e50-417c-a784-12bf78aacca8 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:34.663284 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-88aa3139-5e50-417c-a784-12bf78aacca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:34.747088 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986382d-bc9c-4f70-bf87-1a0c019fd3ca None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:34.804512 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe941cfe-49f7-463d-b810-810133e2fd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:34.805808 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe941cfe-49f7-463d-b810-810133e2fd5e None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:34.806292 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe941cfe-49f7-463d-b810-810133e2fd5e None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:34.806763 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe941cfe-49f7-463d-b810-810133e2fd5e None admin] PATH_INFO: `/v3/users/cecfe9bf486c4fba9525c86babed4c07` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:34.808189 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe941cfe-49f7-463d-b810-810133e2fd5e None admin] RBAC: Authorizing `identity:get_user(user_id=cecfe9bf486c4fba9525c86babed4c07)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:34.816930 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 55/103] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:40:34.826819 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe941cfe-49f7-463d-b810-810133e2fd5e None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:34.829205 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 49/104] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Apr 30 20:40:34 2022] GET /identity/v3/users/cecfe9bf486c4fba9525c86babed4c07 => generated 275 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:34.838044 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa3139-5e50-417c-a784-12bf78aacca8 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:34.846374 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe941cfe-49f7-463d-b810-810133e2fd5e None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:34.988542 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe941cfe-49f7-463d-b810-810133e2fd5e None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:35.033671 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7f622-0846-44f1-8670-1c65fb9e38ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:35.034717 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7f622-0846-44f1-8670-1c65fb9e38ed None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:35.035143 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7f622-0846-44f1-8670-1c65fb9e38ed None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:35.035557 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7f622-0846-44f1-8670-1c65fb9e38ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:35.057441 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7f622-0846-44f1-8670-1c65fb9e38ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:40:35.065282 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-d7a7f622-0846-44f1-8670-1c65fb9e38ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:40:35.065282 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:40:35.065282 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:40:35.065282 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:40:35.065282 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:40:35.065282 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:40:35.065282 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:40:35.065282 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:40:35.065282 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:40:35.065282 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:40:35.065282 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:40:35.065282 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:40:35.065282 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:40:35.065282 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:40:35.065282 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:40:35.065282 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:40:35.066278 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:40:35.066278 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:40:35.066278 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:40:35.066278 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:40:35.066278 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:40:35.066278 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:40:35.066278 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:40:35.066278 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:40:35.066278 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:40:35.066278 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:40:35.066278 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:40:35.066278 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:40:35.066278 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:40:35.066278 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:40:35.066278 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:40:35.066278 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:40:35.067217 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:40:35.067217 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:40:35.067217 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:40:35.067217 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:40:35.067217 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:40:35.067217 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:40:35.067217 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:40:35.067217 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:40:35.067217 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:40:35.067217 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:40:35.067217 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:40:35.067217 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:40:35.074360 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa3139-5e50-417c-a784-12bf78aacca8 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:35.078912 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 50/105] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Apr 30 20:40:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:40:35.086578 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448aa3fe-6baa-4452-a9be-34535e350657 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:35.087059 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448aa3fe-6baa-4452-a9be-34535e350657 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:35.087474 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448aa3fe-6baa-4452-a9be-34535e350657 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:35.088954 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 51/106] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:35.089766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448aa3fe-6baa-4452-a9be-34535e350657 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:35.163625 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df77de-1aa6-49e3-84f4-fb0c30b26758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:35.164816 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df77de-1aa6-49e3-84f4-fb0c30b26758 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:35.165290 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df77de-1aa6-49e3-84f4-fb0c30b26758 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:35.165713 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df77de-1aa6-49e3-84f4-fb0c30b26758 None admin] PATH_INFO: `/v3/projects/b65984e2c7ae400c829003b7ab39d8e2` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:35.168967 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df77de-1aa6-49e3-84f4-fb0c30b26758 None admin] RBAC: Authorizing `identity:get_project(project_id=b65984e2c7ae400c829003b7ab39d8e2)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:35.170774 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df77de-1aa6-49e3-84f4-fb0c30b26758 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:35.174527 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 56/107] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:40:34 2022] GET /identity/v3/projects/b65984e2c7ae400c829003b7ab39d8e2 => generated 298 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:35.177887 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82525b24-79d7-4220-a43d-868e7a7403f8 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:35.183636 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82525b24-79d7-4220-a43d-868e7a7403f8 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:35.184155 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82525b24-79d7-4220-a43d-868e7a7403f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:35.207759 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-82525b24-79d7-4220-a43d-868e7a7403f8 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:35.210363 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-82525b24-79d7-4220-a43d-868e7a7403f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:35.263676 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448aa3fe-6baa-4452-a9be-34535e350657 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:35.341011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49f716-f984-4cff-a485-5665d1653f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:35.341908 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49f716-f984-4cff-a485-5665d1653f16 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:35.342353 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49f716-f984-4cff-a485-5665d1653f16 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:35.342766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49f716-f984-4cff-a485-5665d1653f16 None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:35.343903 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49f716-f984-4cff-a485-5665d1653f16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:35.345593 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49f716-f984-4cff-a485-5665d1653f16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:35.347821 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49f716-f984-4cff-a485-5665d1653f16 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:35.357012 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 57/108] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:40:35.357012 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82525b24-79d7-4220-a43d-868e7a7403f8 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:35.363879 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 52/109] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:40:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:35.365347 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a9bb4-8107-41ac-b0a3-c55c7bbcd8f7 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:35.365527 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a9bb4-8107-41ac-b0a3-c55c7bbcd8f7 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:35.366557 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a9bb4-8107-41ac-b0a3-c55c7bbcd8f7 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:35.367048 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 53/110] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:35.368147 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c49d6e-52f7-4e72-a0f3-fc1acda646f8 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:35.368440 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c49d6e-52f7-4e72-a0f3-fc1acda646f8 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:35.368715 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c49d6e-52f7-4e72-a0f3-fc1acda646f8 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:35.370046 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 54/111] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:35.374585 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c49d6e-52f7-4e72-a0f3-fc1acda646f8 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:35.463474 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82525b24-79d7-4220-a43d-868e7a7403f8 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:35.481222 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c49d6e-52f7-4e72-a0f3-fc1acda646f8 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:35.499077 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662269cf-f50f-4eae-a6a1-db846f2a4175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:35.499978 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662269cf-f50f-4eae-a6a1-db846f2a4175 None admin] REQUEST_METHOD: `PUT` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:35.500266 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662269cf-f50f-4eae-a6a1-db846f2a4175 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:35.500560 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662269cf-f50f-4eae-a6a1-db846f2a4175 None admin] PATH_INFO: `/v3/projects/b65984e2c7ae400c829003b7ab39d8e2/users/cecfe9bf486c4fba9525c86babed4c07/roles/375abc9f701c408ea332eaf2d8a2e086` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:35.503444 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662269cf-f50f-4eae-a6a1-db846f2a4175 None admin] RBAC: Authorizing `identity:create_grant(project_id=b65984e2c7ae400c829003b7ab39d8e2, user_id=cecfe9bf486c4fba9525c86babed4c07, role_id=375abc9f701c408ea332eaf2d8a2e086)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:35.504931 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662269cf-f50f-4eae-a6a1-db846f2a4175 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:35.515690 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae5cf7-8de8-4dd6-92a8-a6cf91b3ee3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:35.516568 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae5cf7-8de8-4dd6-92a8-a6cf91b3ee3f None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:35.516856 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae5cf7-8de8-4dd6-92a8-a6cf91b3ee3f None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:35.517172 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae5cf7-8de8-4dd6-92a8-a6cf91b3ee3f None admin] PATH_INFO: `/v3/users/71f9c03c5c0b40ce81ea052befa2a06c` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:35.519374 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae5cf7-8de8-4dd6-92a8-a6cf91b3ee3f None admin] RBAC: Authorizing `identity:get_user(user_id=71f9c03c5c0b40ce81ea052befa2a06c)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:35.523731 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae5cf7-8de8-4dd6-92a8-a6cf91b3ee3f None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:35.523731 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 55/112] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Apr 30 20:40:35 2022] GET /identity/v3/users/71f9c03c5c0b40ce81ea052befa2a06c => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:35.523731 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cf29a-7381-4964-8ff4-770ba944830d None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:35.524081 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cf29a-7381-4964-8ff4-770ba944830d None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:35.524461 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cf29a-7381-4964-8ff4-770ba944830d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:35.540804 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-7a8cf29a-7381-4964-8ff4-770ba944830d None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:35.542036 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-7a8cf29a-7381-4964-8ff4-770ba944830d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:35.609084 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 58/113] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Apr 30 20:40:35 2022] PUT /identity/v3/projects/b65984e2c7ae400c829003b7ab39d8e2/users/cecfe9bf486c4fba9525c86babed4c07/roles/375abc9f701c408ea332eaf2d8a2e086 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:40:35.609084 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1c313-df8c-40b4-8dab-f1d4f5afff8e None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:35.609084 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1c313-df8c-40b4-8dab-f1d4f5afff8e None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:35.609084 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1c313-df8c-40b4-8dab-f1d4f5afff8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:35.621886 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 56/114] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:40:35.623206 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cf29a-7381-4964-8ff4-770ba944830d None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:35.642194 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-2ed1c313-df8c-40b4-8dab-f1d4f5afff8e None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:35.643750 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-2ed1c313-df8c-40b4-8dab-f1d4f5afff8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:35.727931 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 59/115] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:40:35.729243 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed1c313-df8c-40b4-8dab-f1d4f5afff8e None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:35.763317 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cf29a-7381-4964-8ff4-770ba944830d None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:35.803299 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3798e-96ae-4627-8bcb-d4ab9b0192c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:35.805360 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3798e-96ae-4627-8bcb-d4ab9b0192c4 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:35.805867 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3798e-96ae-4627-8bcb-d4ab9b0192c4 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:35.806385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3798e-96ae-4627-8bcb-d4ab9b0192c4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:35.822972 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3798e-96ae-4627-8bcb-d4ab9b0192c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:40:35.831981 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-fca3798e-96ae-4627-8bcb-d4ab9b0192c4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:40:35.831981 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:40:35.831981 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:40:35.831981 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:40:35.831981 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:40:35.831981 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:40:35.831981 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:40:35.831981 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:40:35.831981 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:40:35.831981 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:40:35.831981 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:40:35.831981 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:40:35.831981 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:40:35.831981 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:40:35.831981 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:40:35.831981 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:40:35.833023 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:40:35.833023 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:40:35.833023 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:40:35.833023 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:40:35.833023 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:40:35.833023 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:40:35.833023 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:40:35.833023 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:40:35.833023 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:40:35.833023 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:40:35.833023 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:40:35.833023 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:40:35.833023 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:40:35.833023 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:40:35.833023 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:40:35.833023 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:40:35.834033 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:40:35.834033 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:40:35.834033 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:40:35.834033 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:40:35.834033 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:40:35.834033 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:40:35.834033 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:40:35.834033 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:40:35.834033 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:40:35.834033 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:40:35.834033 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:40:35.834033 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:40:35.834033 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 57/116] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Apr 30 20:40:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:40:35.834676 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3798e-96ae-4627-8bcb-d4ab9b0192c4 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:35.842945 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed1c313-df8c-40b4-8dab-f1d4f5afff8e None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:35.886622 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd0a4b-c46f-410f-8ccf-b15f19194460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:35.887416 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd0a4b-c46f-410f-8ccf-b15f19194460 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:35.887907 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd0a4b-c46f-410f-8ccf-b15f19194460 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:35.888007 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd0a4b-c46f-410f-8ccf-b15f19194460 None admin] PATH_INFO: `/v3/projects/b65984e2c7ae400c829003b7ab39d8e2` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:35.889725 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd0a4b-c46f-410f-8ccf-b15f19194460 None admin] RBAC: Authorizing `identity:get_project(project_id=b65984e2c7ae400c829003b7ab39d8e2)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:35.890698 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd0a4b-c46f-410f-8ccf-b15f19194460 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:35.892553 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 60/117] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:40:35 2022] GET /identity/v3/projects/b65984e2c7ae400c829003b7ab39d8e2 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:35.893787 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd0a4b-c46f-410f-8ccf-b15f19194460 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:35.965148 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3798e-96ae-4627-8bcb-d4ab9b0192c4 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:35.999919 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784332c4-1cd0-4739-91bc-41ab4dbdeb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:36.000745 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784332c4-1cd0-4739-91bc-41ab4dbdeb28 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:36.001224 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784332c4-1cd0-4739-91bc-41ab4dbdeb28 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:36.001324 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784332c4-1cd0-4739-91bc-41ab4dbdeb28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:36.002508 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784332c4-1cd0-4739-91bc-41ab4dbdeb28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:36.003983 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784332c4-1cd0-4739-91bc-41ab4dbdeb28 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:36.006002 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 58/118] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:40:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:36.006752 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784332c4-1cd0-4739-91bc-41ab4dbdeb28 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:36.008373 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd0a4b-c46f-410f-8ccf-b15f19194460 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:36.043777 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fffeadd-8914-401d-a6c6-b9106f4ab600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:36.045039 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fffeadd-8914-401d-a6c6-b9106f4ab600 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:36.045519 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fffeadd-8914-401d-a6c6-b9106f4ab600 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:36.046012 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fffeadd-8914-401d-a6c6-b9106f4ab600 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:36.057558 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fffeadd-8914-401d-a6c6-b9106f4ab600 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:40:36.065816 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-5fffeadd-8914-401d-a6c6-b9106f4ab600 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 30 20:40:36.065816 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:40:36.065816 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:40:36.065816 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:40:36.065816 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:40:36.065816 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:40:36.065816 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:40:36.065816 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:40:36.065816 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:40:36.065816 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:40:36.065816 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:40:36.065816 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:40:36.065816 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:40:36.065816 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:40:36.065816 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:40:36.065816 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:40:36.066671 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:40:36.066671 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:40:36.066671 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:40:36.066671 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:40:36.066671 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:40:36.066671 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:40:36.066671 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:40:36.066671 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:40:36.066671 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:40:36.066671 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:40:36.066671 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:40:36.066671 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:40:36.066671 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:40:36.066671 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:40:36.066671 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:40:36.066671 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:40:36.067419 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:40:36.067419 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:40:36.067419 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:40:36.067419 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:40:36.067419 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:40:36.067419 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:40:36.067419 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:40:36.067419 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:40:36.067419 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:40:36.067419 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:40:36.067419 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Apr 30 20:40:36.067419 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:40:36.070196 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 61/119] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:40:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:40:36.071222 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fffeadd-8914-401d-a6c6-b9106f4ab600 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:36.112462 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784332c4-1cd0-4739-91bc-41ab4dbdeb28 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:36.145962 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a77835-6c97-4697-9b07-4c18ef495c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:36.146556 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a77835-6c97-4697-9b07-4c18ef495c4b None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:36.146839 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a77835-6c97-4697-9b07-4c18ef495c4b None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:36.147115 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a77835-6c97-4697-9b07-4c18ef495c4b None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:36.147851 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a77835-6c97-4697-9b07-4c18ef495c4b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:36.148214 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a77835-6c97-4697-9b07-4c18ef495c4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:36.149622 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a77835-6c97-4697-9b07-4c18ef495c4b None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:36.162370 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 59/120] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:40:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:36.162370 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a77835-6c97-4697-9b07-4c18ef495c4b None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:36.179895 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fffeadd-8914-401d-a6c6-b9106f4ab600 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:36.214798 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bd5a2-4a2f-4a04-8d56-0100cfc25c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:36.215741 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bd5a2-4a2f-4a04-8d56-0100cfc25c40 None admin] REQUEST_METHOD: `PUT` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:36.216027 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bd5a2-4a2f-4a04-8d56-0100cfc25c40 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:36.216345 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bd5a2-4a2f-4a04-8d56-0100cfc25c40 None admin] PATH_INFO: `/v3/projects/b65984e2c7ae400c829003b7ab39d8e2/users/71f9c03c5c0b40ce81ea052befa2a06c/roles/31b3f11a82cd4cd2823e88aa0e931323` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:36.218294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417bd5a2-4a2f-4a04-8d56-0100cfc25c40 None admin] RBAC: Authorizing `identity:create_grant(project_id=b65984e2c7ae400c829003b7ab39d8e2, user_id=71f9c03c5c0b40ce81ea052befa2a06c, role_id=31b3f11a82cd4cd2823e88aa0e931323)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:36.219807 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417bd5a2-4a2f-4a04-8d56-0100cfc25c40 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:36.257433 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a77835-6c97-4697-9b07-4c18ef495c4b None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:36.289260 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba685e-bfc0-4582-8486-d4fdde97bd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:36.289914 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba685e-bfc0-4582-8486-d4fdde97bd24 None admin] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:36.290193 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba685e-bfc0-4582-8486-d4fdde97bd24 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:36.290470 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba685e-bfc0-4582-8486-d4fdde97bd24 None admin] PATH_INFO: `/v3/projects` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:36.291163 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba685e-bfc0-4582-8486-d4fdde97bd24 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:36.292684 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba685e-bfc0-4582-8486-d4fdde97bd24 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:36.335524 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 62/121] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Apr 30 20:40:36 2022] PUT /identity/v3/projects/b65984e2c7ae400c829003b7ab39d8e2/users/71f9c03c5c0b40ce81ea052befa2a06c/roles/31b3f11a82cd4cd2823e88aa0e931323 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:40:36.336499 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bd5a2-4a2f-4a04-8d56-0100cfc25c40 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:36.425648 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 60/122] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Apr 30 20:40:36 2022] POST /identity/v3/projects => generated 302 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:40:36.427703 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190f553-8555-4505-9456-b90fb546e2e4 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:36.428175 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190f553-8555-4505-9456-b90fb546e2e4 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:36.428630 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190f553-8555-4505-9456-b90fb546e2e4 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:36.433201 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 61/123] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:36.434472 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190f553-8555-4505-9456-b90fb546e2e4 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:36.454444 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bd5a2-4a2f-4a04-8d56-0100cfc25c40 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:36.512327 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73e8d1-562d-47a7-aeee-790da2306ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:36.513248 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73e8d1-562d-47a7-aeee-790da2306ee6 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:36.513666 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73e8d1-562d-47a7-aeee-790da2306ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:36.514056 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73e8d1-562d-47a7-aeee-790da2306ee6 None admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:36.515000 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73e8d1-562d-47a7-aeee-790da2306ee6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:36.515429 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73e8d1-562d-47a7-aeee-790da2306ee6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:36.520798 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73e8d1-562d-47a7-aeee-790da2306ee6 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:36.540092 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 63/124] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Apr 30 20:40:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:36.541244 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5c9fe-751e-4551-a092-713c61c6675e None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:36.541665 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5c9fe-751e-4551-a092-713c61c6675e None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:36.541850 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5c9fe-751e-4551-a092-713c61c6675e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:36.564639 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-aea5c9fe-751e-4551-a092-713c61c6675e None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:36.566473 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-aea5c9fe-751e-4551-a092-713c61c6675e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:36.629086 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190f553-8555-4505-9456-b90fb546e2e4 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:36.649152 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 64/125] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:40:36.650494 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5c9fe-751e-4551-a092-713c61c6675e None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:36.667721 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f15ff5-1e55-4f38-a51f-7e19b0838c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:36.668667 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f15ff5-1e55-4f38-a51f-7e19b0838c78 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:36.668984 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f15ff5-1e55-4f38-a51f-7e19b0838c78 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:36.669277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f15ff5-1e55-4f38-a51f-7e19b0838c78 None admin] PATH_INFO: `/v3/users/cecfe9bf486c4fba9525c86babed4c07` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:36.670547 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f15ff5-1e55-4f38-a51f-7e19b0838c78 None admin] RBAC: Authorizing `identity:get_user(user_id=cecfe9bf486c4fba9525c86babed4c07)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:36.672121 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f15ff5-1e55-4f38-a51f-7e19b0838c78 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:36.677051 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 62/126] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Apr 30 20:40:36 2022] GET /identity/v3/users/cecfe9bf486c4fba9525c86babed4c07 => generated 275 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:36.681694 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f15ff5-1e55-4f38-a51f-7e19b0838c78 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:36.770820 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5c9fe-751e-4551-a092-713c61c6675e None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:36.787573 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f15ff5-1e55-4f38-a51f-7e19b0838c78 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:36.806847 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d2ae9-0a39-40b6-b8a0-4587130efada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:36.808066 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d2ae9-0a39-40b6-b8a0-4587130efada None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:36.808552 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d2ae9-0a39-40b6-b8a0-4587130efada None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:36.809541 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d2ae9-0a39-40b6-b8a0-4587130efada None admin] PATH_INFO: `/v3/users/2972d3b66934493ebf733765cee9f8fa` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:36.824029 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8b273-3db7-4c00-8bf9-063eca4b9f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:36.825080 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8b273-3db7-4c00-8bf9-063eca4b9f28 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:36.825821 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8b273-3db7-4c00-8bf9-063eca4b9f28 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:36.825821 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8b273-3db7-4c00-8bf9-063eca4b9f28 None admin] PATH_INFO: `/v3/projects/b65984e2c7ae400c829003b7ab39d8e2` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:36.826359 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d2ae9-0a39-40b6-b8a0-4587130efada None admin] RBAC: Authorizing `identity:get_user(user_id=2972d3b66934493ebf733765cee9f8fa)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:36.826857 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8b273-3db7-4c00-8bf9-063eca4b9f28 None admin] RBAC: Authorizing `identity:get_project(project_id=b65984e2c7ae400c829003b7ab39d8e2)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:36.828336 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8b273-3db7-4c00-8bf9-063eca4b9f28 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:36.828442 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d2ae9-0a39-40b6-b8a0-4587130efada None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:36.833902 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 63/127] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:40:36 2022] GET /identity/v3/projects/b65984e2c7ae400c829003b7ab39d8e2 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:36.833902 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8b273-3db7-4c00-8bf9-063eca4b9f28 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:36.835248 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 65/128] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Apr 30 20:40:36 2022] GET /identity/v3/users/2972d3b66934493ebf733765cee9f8fa => generated 289 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:36.842177 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d2ae9-0a39-40b6-b8a0-4587130efada None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:36.936843 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8b273-3db7-4c00-8bf9-063eca4b9f28 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:36.947971 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d2ae9-0a39-40b6-b8a0-4587130efada None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:36.974046 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3989bcb-7032-46fb-9e69-a77b323dce02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:36.974859 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3989bcb-7032-46fb-9e69-a77b323dce02 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:36.975151 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3989bcb-7032-46fb-9e69-a77b323dce02 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:36.975687 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3989bcb-7032-46fb-9e69-a77b323dce02 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:36.985595 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af10192-6d59-4c9b-a639-108abf24c194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:36.987281 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af10192-6d59-4c9b-a639-108abf24c194 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:36.987773 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af10192-6d59-4c9b-a639-108abf24c194 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:36.987875 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3989bcb-7032-46fb-9e69-a77b323dce02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:40:36.988346 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af10192-6d59-4c9b-a639-108abf24c194 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:36.995881 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-f3989bcb-7032-46fb-9e69-a77b323dce02 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:40:36.995881 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:40:36.995881 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:40:36.995881 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:40:36.995881 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:40:36.995881 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:40:36.995881 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:40:36.995881 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:40:36.995881 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:40:36.995881 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:40:36.995881 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:40:36.995881 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:40:36.995881 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:40:36.995881 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:40:36.995881 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:40:36.995881 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:40:36.997214 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:40:36.997214 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:40:36.997214 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:40:36.997214 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:40:36.997214 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:40:36.997214 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:40:36.997214 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:40:36.997214 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:40:36.997214 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:40:36.997214 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:40:36.997214 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:40:36.997214 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:40:36.997214 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:40:36.997214 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:40:36.997214 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:40:36.997214 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:40:36.998021 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:40:36.998021 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:40:36.998021 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:40:36.998021 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:40:36.998021 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:40:36.998021 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:40:36.998021 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:40:36.998021 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:40:36.998021 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:40:36.998021 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:40:36.998021 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:40:36.998021 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:40:36.999046 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 64/129] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:40:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:40:36.999266 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3989bcb-7032-46fb-9e69-a77b323dce02 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:37.066343 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af10192-6d59-4c9b-a639-108abf24c194 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:37.068177 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af10192-6d59-4c9b-a639-108abf24c194 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:37.120939 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3989bcb-7032-46fb-9e69-a77b323dce02 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:37.172867 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 66/130] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:40:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:40:37.178169 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af10192-6d59-4c9b-a639-108abf24c194 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:37.182157 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08f5b5-69ef-4580-ab0f-7bc1c8452e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:37.182558 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08f5b5-69ef-4580-ab0f-7bc1c8452e85 None admin] REQUEST_METHOD: `PUT` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:37.182846 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08f5b5-69ef-4580-ab0f-7bc1c8452e85 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:37.183134 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08f5b5-69ef-4580-ab0f-7bc1c8452e85 None admin] PATH_INFO: `/v3/projects/b65984e2c7ae400c829003b7ab39d8e2/users/cecfe9bf486c4fba9525c86babed4c07/roles/f76bb9b1c47a4fbfa232de16b0b4a0d5` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:37.193794 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08f5b5-69ef-4580-ab0f-7bc1c8452e85 None admin] RBAC: Authorizing `identity:create_grant(project_id=b65984e2c7ae400c829003b7ab39d8e2, user_id=cecfe9bf486c4fba9525c86babed4c07, role_id=f76bb9b1c47a4fbfa232de16b0b4a0d5)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:37.195213 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08f5b5-69ef-4580-ab0f-7bc1c8452e85 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:37.284557 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af10192-6d59-4c9b-a639-108abf24c194 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:37.295786 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 65/131] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Apr 30 20:40:36 2022] PUT /identity/v3/projects/b65984e2c7ae400c829003b7ab39d8e2/users/cecfe9bf486c4fba9525c86babed4c07/roles/f76bb9b1c47a4fbfa232de16b0b4a0d5 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:40:37.301168 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08f5b5-69ef-4580-ab0f-7bc1c8452e85 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:37.336587 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d423e-4436-4865-8285-16f09ff63386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:37.337728 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d423e-4436-4865-8285-16f09ff63386 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:37.338221 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d423e-4436-4865-8285-16f09ff63386 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:37.338699 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d423e-4436-4865-8285-16f09ff63386 None admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:37.339723 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d423e-4436-4865-8285-16f09ff63386 None admin] RBAC: Adding query filter params (name=member) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:37.340234 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d423e-4436-4865-8285-16f09ff63386 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:37.341873 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d423e-4436-4865-8285-16f09ff63386 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:37.358781 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 67/132] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Apr 30 20:40:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:37.372459 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d423e-4436-4865-8285-16f09ff63386 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:37.442259 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08f5b5-69ef-4580-ab0f-7bc1c8452e85 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:37.492175 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8dc38c-0275-41fa-b411-a3184d2ea308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:37.492997 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dc38c-0275-41fa-b411-a3184d2ea308 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:37.493287 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dc38c-0275-41fa-b411-a3184d2ea308 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:37.493673 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dc38c-0275-41fa-b411-a3184d2ea308 None admin] PATH_INFO: `/v3/projects/b65984e2c7ae400c829003b7ab39d8e2` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:37.497811 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8dc38c-0275-41fa-b411-a3184d2ea308 None admin] RBAC: Authorizing `identity:get_project(project_id=b65984e2c7ae400c829003b7ab39d8e2)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:37.499306 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8dc38c-0275-41fa-b411-a3184d2ea308 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:37.501131 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 66/133] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:40:37 2022] GET /identity/v3/projects/b65984e2c7ae400c829003b7ab39d8e2 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:37.507579 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8dc38c-0275-41fa-b411-a3184d2ea308 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:37.516652 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d423e-4436-4865-8285-16f09ff63386 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:37.554760 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062d615-8abd-4d27-8a30-f66779a2201b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:37.555658 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062d615-8abd-4d27-8a30-f66779a2201b None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:37.555997 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062d615-8abd-4d27-8a30-f66779a2201b None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:37.556285 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062d615-8abd-4d27-8a30-f66779a2201b None admin] PATH_INFO: `/v3/users/cecfe9bf486c4fba9525c86babed4c07` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:37.557586 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062d615-8abd-4d27-8a30-f66779a2201b None admin] RBAC: Authorizing `identity:get_user(user_id=cecfe9bf486c4fba9525c86babed4c07)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:37.559107 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062d615-8abd-4d27-8a30-f66779a2201b None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:37.560780 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 68/134] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Apr 30 20:40:37 2022] GET /identity/v3/users/cecfe9bf486c4fba9525c86babed4c07 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:40:37.566659 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062d615-8abd-4d27-8a30-f66779a2201b None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:37.674884 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062d615-8abd-4d27-8a30-f66779a2201b None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:37.675068 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8dc38c-0275-41fa-b411-a3184d2ea308 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:37.710177 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289d27f-eaec-4ba8-a3aa-4e6cbc0a2765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:37.711060 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289d27f-eaec-4ba8-a3aa-4e6cbc0a2765 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:37.711341 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289d27f-eaec-4ba8-a3aa-4e6cbc0a2765 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:37.711613 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289d27f-eaec-4ba8-a3aa-4e6cbc0a2765 None admin] PATH_INFO: `/v3/projects/4972609a22ba4b78bd1a06cf5b0712e2` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:37.712972 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289d27f-eaec-4ba8-a3aa-4e6cbc0a2765 None admin] RBAC: Authorizing `identity:get_project(project_id=4972609a22ba4b78bd1a06cf5b0712e2)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:37.714616 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289d27f-eaec-4ba8-a3aa-4e6cbc0a2765 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:37.716370 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 69/135] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:40:37 2022] GET /identity/v3/projects/4972609a22ba4b78bd1a06cf5b0712e2 => generated 312 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:40:37.723057 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289d27f-eaec-4ba8-a3aa-4e6cbc0a2765 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:37.734302 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f1e9c-6414-46f8-ad6f-10b88ea75df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:37.738822 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f1e9c-6414-46f8-ad6f-10b88ea75df3 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:37.738822 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f1e9c-6414-46f8-ad6f-10b88ea75df3 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:37.738822 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f1e9c-6414-46f8-ad6f-10b88ea75df3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:37.738822 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f1e9c-6414-46f8-ad6f-10b88ea75df3 None admin] RBAC: Adding query filter params (role.id=ca508df0c9124b8d97536818daba3aee, scope.project.id=b65984e2c7ae400c829003b7ab39d8e2, user.id=2972d3b66934493ebf733765cee9f8fa) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:37.738822 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f1e9c-6414-46f8-ad6f-10b88ea75df3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:37.738822 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f1e9c-6414-46f8-ad6f-10b88ea75df3 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:37.751261 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 67/136] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Apr 30 20:40:37 2022] GET /identity/v3/role_assignments?user.id=2972d3b66934493ebf733765cee9f8fa&scope.project.id=b65984e2c7ae400c829003b7ab39d8e2&role.id=ca508df0c9124b8d97536818daba3aee => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:40:37.851049 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289d27f-eaec-4ba8-a3aa-4e6cbc0a2765 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:37.889246 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d34e7c-de65-4af3-9762-75f4d4988287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:37.890166 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d34e7c-de65-4af3-9762-75f4d4988287 None admin] REQUEST_METHOD: `PUT` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:37.890451 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d34e7c-de65-4af3-9762-75f4d4988287 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:37.890727 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d34e7c-de65-4af3-9762-75f4d4988287 None admin] PATH_INFO: `/v3/projects/4972609a22ba4b78bd1a06cf5b0712e2/users/cecfe9bf486c4fba9525c86babed4c07/roles/375abc9f701c408ea332eaf2d8a2e086` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:37.893140 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d34e7c-de65-4af3-9762-75f4d4988287 None admin] RBAC: Authorizing `identity:create_grant(project_id=4972609a22ba4b78bd1a06cf5b0712e2, user_id=cecfe9bf486c4fba9525c86babed4c07, role_id=375abc9f701c408ea332eaf2d8a2e086)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:37.894761 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d34e7c-de65-4af3-9762-75f4d4988287 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:37.977614 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 70/137] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Apr 30 20:40:37 2022] PUT /identity/v3/projects/4972609a22ba4b78bd1a06cf5b0712e2/users/cecfe9bf486c4fba9525c86babed4c07/roles/375abc9f701c408ea332eaf2d8a2e086 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 20:40:38.316228 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc7c33-ac4e-427a-8a22-642fb9d80f2c None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:38.316743 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc7c33-ac4e-427a-8a22-642fb9d80f2c None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:38.316814 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc7c33-ac4e-427a-8a22-642fb9d80f2c None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:38.318224 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 68/138] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:38.323937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1388aeb-2eb7-44bf-880d-1ed23f7f69c6 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:38.324400 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1388aeb-2eb7-44bf-880d-1ed23f7f69c6 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:38.324469 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1388aeb-2eb7-44bf-880d-1ed23f7f69c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:38.347182 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-c1388aeb-2eb7-44bf-880d-1ed23f7f69c6 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:38.348365 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-c1388aeb-2eb7-44bf-880d-1ed23f7f69c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:38.447756 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 71/139] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:40:38.494801 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc7c33-ac4e-427a-8a22-642fb9d80f2c None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:38.630685 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc7c33-ac4e-427a-8a22-642fb9d80f2c None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:38.672444 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e011fed-3b32-444f-ab19-c6d658370e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:38.673292 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e011fed-3b32-444f-ab19-c6d658370e65 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:38.673577 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e011fed-3b32-444f-ab19-c6d658370e65 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:38.673856 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e011fed-3b32-444f-ab19-c6d658370e65 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:38.691761 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e011fed-3b32-444f-ab19-c6d658370e65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:40:38.699512 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-7e011fed-3b32-444f-ab19-c6d658370e65 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:40:38.699512 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:40:38.699512 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:40:38.699512 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:40:38.699512 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:40:38.699512 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:40:38.699512 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:40:38.699512 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:40:38.699512 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:40:38.699512 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:40:38.699512 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:40:38.699512 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:40:38.699512 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:40:38.699512 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:40:38.699512 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:40:38.699512 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:40:38.703152 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:40:38.703152 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:40:38.703152 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:40:38.703152 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:40:38.703152 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:40:38.703152 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:40:38.703152 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:40:38.703152 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:40:38.703152 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:40:38.703152 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:40:38.703152 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:40:38.703152 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:40:38.703152 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:40:38.703152 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:40:38.703152 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:40:38.703152 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:40:38.705166 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:40:38.705166 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:40:38.705166 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:40:38.705166 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:40:38.705166 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:40:38.705166 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:40:38.705166 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:40:38.705166 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:40:38.705166 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:40:38.705166 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:40:38.705166 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:40:38.705166 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:40:38.705166 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 69/140] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:40:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:40:38.708983 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1388aeb-2eb7-44bf-880d-1ed23f7f69c6 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:38.842802 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1388aeb-2eb7-44bf-880d-1ed23f7f69c6 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:38.879376 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bc33f-ba8c-4bb4-9d09-6e478fa809c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:38.880053 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bc33f-ba8c-4bb4-9d09-6e478fa809c9 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:38.880336 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bc33f-ba8c-4bb4-9d09-6e478fa809c9 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:38.880610 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bc33f-ba8c-4bb4-9d09-6e478fa809c9 None admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:38.881440 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3bc33f-ba8c-4bb4-9d09-6e478fa809c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:38.881690 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3bc33f-ba8c-4bb4-9d09-6e478fa809c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:38.883082 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3bc33f-ba8c-4bb4-9d09-6e478fa809c9 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:38.892314 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 72/141] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Apr 30 20:40:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:38.898315 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e011fed-3b32-444f-ab19-c6d658370e65 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:39.067810 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e011fed-3b32-444f-ab19-c6d658370e65 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:39.108794 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14073100-cc8a-4a1c-b57d-70e0f5adc858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:39.109731 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14073100-cc8a-4a1c-b57d-70e0f5adc858 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:39.110021 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14073100-cc8a-4a1c-b57d-70e0f5adc858 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:39.110302 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14073100-cc8a-4a1c-b57d-70e0f5adc858 None admin] PATH_INFO: `/v3/users/cecfe9bf486c4fba9525c86babed4c07` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:39.111698 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14073100-cc8a-4a1c-b57d-70e0f5adc858 None admin] RBAC: Authorizing `identity:get_user(user_id=cecfe9bf486c4fba9525c86babed4c07)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:39.114471 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14073100-cc8a-4a1c-b57d-70e0f5adc858 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:39.117870 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 70/142] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Apr 30 20:40:38 2022] GET /identity/v3/users/cecfe9bf486c4fba9525c86babed4c07 => generated 275 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:39.123324 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bc33f-ba8c-4bb4-9d09-6e478fa809c9 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:39.262259 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bc33f-ba8c-4bb4-9d09-6e478fa809c9 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:39.303755 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f2cac-386c-4ae8-8f2e-d6e77cc386d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:39.304864 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f2cac-386c-4ae8-8f2e-d6e77cc386d4 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:39.305517 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f2cac-386c-4ae8-8f2e-d6e77cc386d4 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:39.305955 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f2cac-386c-4ae8-8f2e-d6e77cc386d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:39.380425 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f2cac-386c-4ae8-8f2e-d6e77cc386d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:39.382663 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f2cac-386c-4ae8-8f2e-d6e77cc386d4 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:39.484488 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 73/143] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:40:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:40:39.494024 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14073100-cc8a-4a1c-b57d-70e0f5adc858 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:39.552584 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb234792-2e9b-4e46-a1e7-e99401c6b0d5 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:39.552854 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb234792-2e9b-4e46-a1e7-e99401c6b0d5 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:39.553123 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb234792-2e9b-4e46-a1e7-e99401c6b0d5 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:39.554486 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 74/144] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:40:39.561958 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce1e7b-f3e8-4a84-a925-e81e9e46d853 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:39.562243 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce1e7b-f3e8-4a84-a925-e81e9e46d853 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:39.562524 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce1e7b-f3e8-4a84-a925-e81e9e46d853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:39.585473 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-26ce1e7b-f3e8-4a84-a925-e81e9e46d853 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:39.586687 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-26ce1e7b-f3e8-4a84-a925-e81e9e46d853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:39.648932 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14073100-cc8a-4a1c-b57d-70e0f5adc858 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:39.679836 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 75/145] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:40:39.692537 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98752fc5-8f2c-489d-ab44-19cd54f76a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:39.693447 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98752fc5-8f2c-489d-ab44-19cd54f76a92 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:39.693735 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98752fc5-8f2c-489d-ab44-19cd54f76a92 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:39.694014 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98752fc5-8f2c-489d-ab44-19cd54f76a92 None admin] PATH_INFO: `/v3/projects/b65984e2c7ae400c829003b7ab39d8e2` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:39.697626 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98752fc5-8f2c-489d-ab44-19cd54f76a92 None admin] RBAC: Authorizing `identity:get_project(project_id=b65984e2c7ae400c829003b7ab39d8e2)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:39.699098 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98752fc5-8f2c-489d-ab44-19cd54f76a92 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:39.700819 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 71/146] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:40:39 2022] GET /identity/v3/projects/b65984e2c7ae400c829003b7ab39d8e2 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:39.706854 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce1e7b-f3e8-4a84-a925-e81e9e46d853 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:39.721276 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98752fc5-8f2c-489d-ab44-19cd54f76a92 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:39.917375 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce1e7b-f3e8-4a84-a925-e81e9e46d853 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:39.934543 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98752fc5-8f2c-489d-ab44-19cd54f76a92 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:39.962975 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b635d0a-77f2-4fa0-95f0-cdf155cc596d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:39.963646 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b635d0a-77f2-4fa0-95f0-cdf155cc596d None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:39.963936 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b635d0a-77f2-4fa0-95f0-cdf155cc596d None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:39.964221 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b635d0a-77f2-4fa0-95f0-cdf155cc596d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:39.965077 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b635d0a-77f2-4fa0-95f0-cdf155cc596d None admin] RBAC: Adding query filter params (role.id=375abc9f701c408ea332eaf2d8a2e086, scope.project.id=b65984e2c7ae400c829003b7ab39d8e2, user.id=cecfe9bf486c4fba9525c86babed4c07) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:39.965395 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b635d0a-77f2-4fa0-95f0-cdf155cc596d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:39.966851 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b635d0a-77f2-4fa0-95f0-cdf155cc596d None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:39.973630 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 76/147] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Apr 30 20:40:39 2022] GET /identity/v3/role_assignments?user.id=cecfe9bf486c4fba9525c86babed4c07&scope.project.id=b65984e2c7ae400c829003b7ab39d8e2&role.id=375abc9f701c408ea332eaf2d8a2e086 => generated 608 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:40:39.978763 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2d50e-0de9-48ce-b101-313d300a2e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:39.979639 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2d50e-0de9-48ce-b101-313d300a2e0c None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:39.979928 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2d50e-0de9-48ce-b101-313d300a2e0c None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:39.980212 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2d50e-0de9-48ce-b101-313d300a2e0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:40.001214 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2d50e-0de9-48ce-b101-313d300a2e0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:40:40.013968 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-4bd2d50e-0de9-48ce-b101-313d300a2e0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:40:40.013968 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:40:40.013968 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:40:40.013968 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:40:40.013968 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:40:40.013968 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:40:40.013968 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:40:40.013968 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:40:40.013968 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:40:40.013968 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:40:40.013968 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:40:40.013968 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:40:40.013968 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:40:40.013968 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:40:40.013968 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:40:40.013968 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:40:40.016442 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:40:40.016442 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:40:40.016442 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:40:40.016442 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:40:40.016442 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:40:40.016442 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:40:40.016442 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:40:40.016442 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:40:40.016442 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:40:40.016442 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:40:40.016442 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:40:40.016442 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:40:40.016442 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:40:40.016442 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:40:40.016442 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:40:40.016442 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:40:40.018953 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:40:40.018953 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:40:40.018953 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:40:40.018953 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:40:40.018953 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:40:40.018953 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:40:40.018953 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:40:40.018953 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:40:40.018953 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:40:40.018953 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:40:40.018953 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:40:40.018953 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:40:40.018953 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 72/148] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Apr 30 20:40:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:40:40.024933 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b635d0a-77f2-4fa0-95f0-cdf155cc596d None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:40.164036 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b635d0a-77f2-4fa0-95f0-cdf155cc596d None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:40.213387 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82adf0-6a05-4023-ae24-994152f50386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:40.214082 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82adf0-6a05-4023-ae24-994152f50386 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:40.214368 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82adf0-6a05-4023-ae24-994152f50386 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:40.214645 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82adf0-6a05-4023-ae24-994152f50386 None admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:40.215400 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82adf0-6a05-4023-ae24-994152f50386 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:40.215706 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82adf0-6a05-4023-ae24-994152f50386 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:40.217165 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82adf0-6a05-4023-ae24-994152f50386 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:40.229253 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 77/149] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:40:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:40.238135 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2d50e-0de9-48ce-b101-313d300a2e0c None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:40.311328 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff61612-a235-4e80-a90b-d9c9b3afb1d3 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:40.311633 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff61612-a235-4e80-a90b-d9c9b3afb1d3 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:40.311893 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff61612-a235-4e80-a90b-d9c9b3afb1d3 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:40.313586 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 78/150] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:40.326295 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88748c-03ad-4c63-946b-8e07d51e7040 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:40.326582 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88748c-03ad-4c63-946b-8e07d51e7040 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:40.326863 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88748c-03ad-4c63-946b-8e07d51e7040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:40.360107 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2d50e-0de9-48ce-b101-313d300a2e0c None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:40.370071 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-3f88748c-03ad-4c63-946b-8e07d51e7040 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:40.371307 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-3f88748c-03ad-4c63-946b-8e07d51e7040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:40.398492 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375daaa-ef6c-4e2b-9420-662117e0317f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:40.399375 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375daaa-ef6c-4e2b-9420-662117e0317f None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:40.399749 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375daaa-ef6c-4e2b-9420-662117e0317f None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:40.400027 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375daaa-ef6c-4e2b-9420-662117e0317f None admin] PATH_INFO: `/v3/users/71f9c03c5c0b40ce81ea052befa2a06c` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:40.402032 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e375daaa-ef6c-4e2b-9420-662117e0317f None admin] RBAC: Authorizing `identity:get_user(user_id=71f9c03c5c0b40ce81ea052befa2a06c)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:40.405243 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e375daaa-ef6c-4e2b-9420-662117e0317f None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:40.406878 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 73/151] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Apr 30 20:40:40 2022] GET /identity/v3/users/71f9c03c5c0b40ce81ea052befa2a06c => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:40.413826 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375daaa-ef6c-4e2b-9420-662117e0317f None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:40.511541 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 79/152] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:40:40.557156 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375daaa-ef6c-4e2b-9420-662117e0317f None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:40.560393 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88748c-03ad-4c63-946b-8e07d51e7040 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:40.605655 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0739332-80fe-491e-b6af-7640a73ea6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:40.606747 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0739332-80fe-491e-b6af-7640a73ea6c1 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:40.607241 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0739332-80fe-491e-b6af-7640a73ea6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:40.607726 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0739332-80fe-491e-b6af-7640a73ea6c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:40.696524 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88748c-03ad-4c63-946b-8e07d51e7040 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:40.742034 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a67f19-820a-4af4-af02-09d85d4141bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:40.742838 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a67f19-820a-4af4-af02-09d85d4141bf None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:40.743113 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a67f19-820a-4af4-af02-09d85d4141bf None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:40.743381 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a67f19-820a-4af4-af02-09d85d4141bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:40.744771 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a67f19-820a-4af4-af02-09d85d4141bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:40.746273 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a67f19-820a-4af4-af02-09d85d4141bf None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:40.747895 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 80/153] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:40:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:40.748776 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0739332-80fe-491e-b6af-7640a73ea6c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:40.750334 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0739332-80fe-491e-b6af-7640a73ea6c1 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:40.754836 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a67f19-820a-4af4-af02-09d85d4141bf None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:40.862653 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 74/154] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:40:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:40:40.873979 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0739332-80fe-491e-b6af-7640a73ea6c1 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:40.925688 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a67f19-820a-4af4-af02-09d85d4141bf None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:40.974551 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb107bf6-b87b-4669-9d6e-5e3b10b220ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:40.975239 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb107bf6-b87b-4669-9d6e-5e3b10b220ba None admin] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:40.975781 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb107bf6-b87b-4669-9d6e-5e3b10b220ba None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:40.976062 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb107bf6-b87b-4669-9d6e-5e3b10b220ba None admin] PATH_INFO: `/v3/users` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:40.976777 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb107bf6-b87b-4669-9d6e-5e3b10b220ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:40.978394 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb107bf6-b87b-4669-9d6e-5e3b10b220ba None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:40.979076 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0739332-80fe-491e-b6af-7640a73ea6c1 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:41.014668 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806548f4-f476-4ef6-a98e-c44ee07acc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:41.015531 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806548f4-f476-4ef6-a98e-c44ee07acc27 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:41.015871 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806548f4-f476-4ef6-a98e-c44ee07acc27 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:41.016154 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806548f4-f476-4ef6-a98e-c44ee07acc27 None admin] PATH_INFO: `/v3/projects/b65984e2c7ae400c829003b7ab39d8e2` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:41.017372 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806548f4-f476-4ef6-a98e-c44ee07acc27 None admin] RBAC: Authorizing `identity:get_project(project_id=b65984e2c7ae400c829003b7ab39d8e2)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:41.018878 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806548f4-f476-4ef6-a98e-c44ee07acc27 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:41.020842 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 75/155] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:40:40 2022] GET /identity/v3/projects/b65984e2c7ae400c829003b7ab39d8e2 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:41.026582 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806548f4-f476-4ef6-a98e-c44ee07acc27 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:41.099810 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 81/156] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Apr 30 20:40:40 2022] POST /identity/v3/users => generated 283 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:40:41.113372 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e890e46-2c0a-4960-ac18-beb4b0e325d2 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:41.113673 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e890e46-2c0a-4960-ac18-beb4b0e325d2 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:41.113955 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e890e46-2c0a-4960-ac18-beb4b0e325d2 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:41.115369 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 82/157] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:40:41.122060 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c9ce4-c07d-418d-8e11-030402d29343 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:41.122349 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c9ce4-c07d-418d-8e11-030402d29343 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:41.122630 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c9ce4-c07d-418d-8e11-030402d29343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:41.133403 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806548f4-f476-4ef6-a98e-c44ee07acc27 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:41.162220 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-0d1c9ce4-c07d-418d-8e11-030402d29343 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:41.163472 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-0d1c9ce4-c07d-418d-8e11-030402d29343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:41.176763 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfed72-d5ec-4212-b015-62e73203fa47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:41.177499 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfed72-d5ec-4212-b015-62e73203fa47 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:41.177787 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfed72-d5ec-4212-b015-62e73203fa47 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:41.178069 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfed72-d5ec-4212-b015-62e73203fa47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:41.178931 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdfed72-d5ec-4212-b015-62e73203fa47 None admin] RBAC: Adding query filter params (role.id=31b3f11a82cd4cd2823e88aa0e931323, scope.project.id=b65984e2c7ae400c829003b7ab39d8e2, user.id=71f9c03c5c0b40ce81ea052befa2a06c) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:41.179930 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdfed72-d5ec-4212-b015-62e73203fa47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:41.182020 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdfed72-d5ec-4212-b015-62e73203fa47 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:41.190527 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 76/158] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Apr 30 20:40:41 2022] GET /identity/v3/role_assignments?user.id=71f9c03c5c0b40ce81ea052befa2a06c&scope.project.id=b65984e2c7ae400c829003b7ab39d8e2&role.id=31b3f11a82cd4cd2823e88aa0e931323 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:40:41.303664 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 83/159] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:40:41.346623 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfed72-d5ec-4212-b015-62e73203fa47 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:41.435507 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ea1e0-302d-4cc6-87d4-235aa129094f None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:41.435796 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ea1e0-302d-4cc6-87d4-235aa129094f None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:41.435983 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ea1e0-302d-4cc6-87d4-235aa129094f None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:41.437427 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 84/160] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:41.447195 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97dce3-2f79-42c3-9295-b6bb7e6a9f10 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:41.447492 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97dce3-2f79-42c3-9295-b6bb7e6a9f10 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:41.448115 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97dce3-2f79-42c3-9295-b6bb7e6a9f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:41.468778 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-cd97dce3-2f79-42c3-9295-b6bb7e6a9f10 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:41.470013 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-cd97dce3-2f79-42c3-9295-b6bb7e6a9f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:41.472353 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfed72-d5ec-4212-b015-62e73203fa47 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:41.511502 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa828494-713d-4002-ab2e-c0ae652efd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:41.512396 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa828494-713d-4002-ab2e-c0ae652efd08 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:41.512618 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa828494-713d-4002-ab2e-c0ae652efd08 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:41.513293 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa828494-713d-4002-ab2e-c0ae652efd08 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:41.530111 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa828494-713d-4002-ab2e-c0ae652efd08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:40:41.540036 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-aa828494-713d-4002-ab2e-c0ae652efd08 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:40:41.540036 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:40:41.540036 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:40:41.540036 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:40:41.540036 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:40:41.540036 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:40:41.540036 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:40:41.540036 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:40:41.540036 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:40:41.540036 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:40:41.540036 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:40:41.540036 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:40:41.540036 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:40:41.540036 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:40:41.540036 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:40:41.540036 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:40:41.541260 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:40:41.541260 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:40:41.541260 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:40:41.541260 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:40:41.541260 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:40:41.541260 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:40:41.541260 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:40:41.541260 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:40:41.541260 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:40:41.541260 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:40:41.541260 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:40:41.541260 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:40:41.541260 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:40:41.541260 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:40:41.541260 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:40:41.541260 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:40:41.542233 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:40:41.542233 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:40:41.542233 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:40:41.542233 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:40:41.542233 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:40:41.542233 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:40:41.542233 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:40:41.542233 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:40:41.542233 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:40:41.542233 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:40:41.542233 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:40:41.542233 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:40:41.542233 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 77/161] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Apr 30 20:40:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:40:41.547724 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa828494-713d-4002-ab2e-c0ae652efd08 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:41.571849 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 85/162] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:40:41.598020 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97dce3-2f79-42c3-9295-b6bb7e6a9f10 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:41.675126 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa828494-713d-4002-ab2e-c0ae652efd08 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:41.720538 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2dd489-887c-4f76-925e-54849feff030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:41.721511 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2dd489-887c-4f76-925e-54849feff030 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:41.721802 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2dd489-887c-4f76-925e-54849feff030 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:41.722081 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2dd489-887c-4f76-925e-54849feff030 None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:41.722876 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2dd489-887c-4f76-925e-54849feff030 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:41.723188 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2dd489-887c-4f76-925e-54849feff030 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:41.724598 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2dd489-887c-4f76-925e-54849feff030 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:41.733442 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 78/163] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:40:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:40:41.736363 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97dce3-2f79-42c3-9295-b6bb7e6a9f10 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:41.739672 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2dd489-887c-4f76-925e-54849feff030 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:41.781939 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9fb3b-9b96-47e1-8fbf-2dc100f44ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:41.782739 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9fb3b-9b96-47e1-8fbf-2dc100f44ab7 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:41.783027 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9fb3b-9b96-47e1-8fbf-2dc100f44ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:41.783371 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9fb3b-9b96-47e1-8fbf-2dc100f44ab7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:41.799561 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9fb3b-9b96-47e1-8fbf-2dc100f44ab7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:40:41.808752 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-bbf9fb3b-9b96-47e1-8fbf-2dc100f44ab7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 30 20:40:41.808752 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:40:41.808752 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:40:41.808752 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:40:41.808752 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:40:41.808752 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:40:41.808752 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:40:41.808752 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:40:41.808752 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:40:41.808752 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:40:41.808752 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:40:41.808752 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:40:41.808752 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:40:41.808752 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:40:41.808752 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:40:41.808752 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:40:41.809741 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:40:41.809741 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:40:41.809741 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:40:41.809741 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:40:41.809741 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:40:41.809741 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:40:41.809741 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:40:41.809741 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:40:41.809741 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:40:41.809741 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:40:41.809741 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:40:41.809741 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:40:41.809741 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:40:41.809741 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:40:41.809741 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:40:41.809741 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:40:41.810594 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:40:41.810594 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:40:41.810594 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:40:41.810594 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:40:41.810594 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:40:41.810594 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:40:41.810594 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:40:41.810594 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:40:41.810594 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:40:41.810594 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:40:41.810594 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Apr 30 20:40:41.810594 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:40:41.812630 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 86/164] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:40:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:40:41.814167 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d49c1-3755-4bb4-b257-203e14c8cd9a None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:41.814485 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d49c1-3755-4bb4-b257-203e14c8cd9a None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:41.815337 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d49c1-3755-4bb4-b257-203e14c8cd9a None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:41.816637 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 87/165] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:41.823459 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d49c1-3755-4bb4-b257-203e14c8cd9a None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:41.870601 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2dd489-887c-4f76-925e-54849feff030 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:41.920459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338b4ae-eae2-441b-884d-f9d5f6936b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:41.921437 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338b4ae-eae2-441b-884d-f9d5f6936b61 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:41.921724 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338b4ae-eae2-441b-884d-f9d5f6936b61 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:41.922053 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338b4ae-eae2-441b-884d-f9d5f6936b61 None admin] PATH_INFO: `/v3/users/cecfe9bf486c4fba9525c86babed4c07` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:41.923468 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338b4ae-eae2-441b-884d-f9d5f6936b61 None admin] RBAC: Authorizing `identity:get_user(user_id=cecfe9bf486c4fba9525c86babed4c07)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:41.925886 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338b4ae-eae2-441b-884d-f9d5f6936b61 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:41.928131 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 79/166] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Apr 30 20:40:41 2022] GET /identity/v3/users/cecfe9bf486c4fba9525c86babed4c07 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:40:41.934398 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45adb2-8197-40ee-b534-2f5a0eb82b89 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:41.934702 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45adb2-8197-40ee-b534-2f5a0eb82b89 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:41.934962 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45adb2-8197-40ee-b534-2f5a0eb82b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:41.948224 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d49c1-3755-4bb4-b257-203e14c8cd9a None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:41.956490 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-5c45adb2-8197-40ee-b534-2f5a0eb82b89 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:41.958475 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-5c45adb2-8197-40ee-b534-2f5a0eb82b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:41.988514 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793f4c6-27c6-444e-b33f-cd61e42cd580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:41.989578 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793f4c6-27c6-444e-b33f-cd61e42cd580 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:41.990113 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793f4c6-27c6-444e-b33f-cd61e42cd580 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:41.990608 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793f4c6-27c6-444e-b33f-cd61e42cd580 None admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:41.991567 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793f4c6-27c6-444e-b33f-cd61e42cd580 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:41.992128 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793f4c6-27c6-444e-b33f-cd61e42cd580 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:41.993804 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793f4c6-27c6-444e-b33f-cd61e42cd580 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:42.004600 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 88/167] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Apr 30 20:40:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:40:42.005796 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793f4c6-27c6-444e-b33f-cd61e42cd580 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:42.044929 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 80/168] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:40:42.044929 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45adb2-8197-40ee-b534-2f5a0eb82b89 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:42.150047 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793f4c6-27c6-444e-b33f-cd61e42cd580 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:42.158739 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45adb2-8197-40ee-b534-2f5a0eb82b89 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:42.192435 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a58be6-466f-4780-9314-089cbe80487c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:42.193215 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a58be6-466f-4780-9314-089cbe80487c None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:42.193501 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a58be6-466f-4780-9314-089cbe80487c None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:42.193778 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a58be6-466f-4780-9314-089cbe80487c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:42.196505 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56e6ab-0ade-406f-9908-d9349b8fc2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:42.197650 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56e6ab-0ade-406f-9908-d9349b8fc2fc None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:42.201278 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56e6ab-0ade-406f-9908-d9349b8fc2fc None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:42.201788 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56e6ab-0ade-406f-9908-d9349b8fc2fc None admin] PATH_INFO: `/v3/users/2972d3b66934493ebf733765cee9f8fa` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:42.206941 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56e6ab-0ade-406f-9908-d9349b8fc2fc None admin] RBAC: Authorizing `identity:get_user(user_id=2972d3b66934493ebf733765cee9f8fa)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:42.208715 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56e6ab-0ade-406f-9908-d9349b8fc2fc None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:42.210721 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 81/169] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Apr 30 20:40:42 2022] GET /identity/v3/users/2972d3b66934493ebf733765cee9f8fa => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:42.211783 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56e6ab-0ade-406f-9908-d9349b8fc2fc None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:42.268768 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a58be6-466f-4780-9314-089cbe80487c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:42.270587 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a58be6-466f-4780-9314-089cbe80487c None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:42.344157 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56e6ab-0ade-406f-9908-d9349b8fc2fc None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:42.387832 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c09df2-5939-451e-ba06-3044471d4769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:42.388637 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c09df2-5939-451e-ba06-3044471d4769 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:42.388946 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c09df2-5939-451e-ba06-3044471d4769 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:42.389210 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c09df2-5939-451e-ba06-3044471d4769 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:42.390236 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 89/170] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:40:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:40:42.391292 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a58be6-466f-4780-9314-089cbe80487c None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:42.402046 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c09df2-5939-451e-ba06-3044471d4769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:40:42.412553 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-86c09df2-5939-451e-ba06-3044471d4769 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:40:42.412553 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:40:42.412553 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:40:42.412553 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:40:42.412553 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:40:42.412553 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:40:42.412553 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:40:42.412553 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:40:42.412553 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:40:42.412553 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:40:42.412553 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:40:42.412553 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:40:42.412553 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:40:42.412553 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:40:42.412553 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:40:42.412553 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:40:42.413519 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:40:42.413519 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:40:42.413519 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:40:42.413519 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:40:42.413519 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:40:42.413519 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:40:42.413519 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:40:42.413519 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:40:42.413519 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:40:42.413519 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:40:42.413519 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:40:42.413519 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:40:42.413519 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:40:42.413519 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:40:42.413519 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:40:42.413519 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:40:42.414282 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:40:42.414282 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:40:42.414282 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:40:42.414282 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:40:42.414282 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:40:42.414282 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:40:42.414282 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:40:42.414282 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:40:42.414282 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:40:42.414282 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:40:42.414282 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:40:42.414282 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:40:42.414282 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 82/171] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:40:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:40:42.415135 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c09df2-5939-451e-ba06-3044471d4769 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:42.522507 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c09df2-5939-451e-ba06-3044471d4769 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:42.523742 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a58be6-466f-4780-9314-089cbe80487c None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:42.559128 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b90f7-0e16-4f8c-82ae-53c33945ce5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:42.560407 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b90f7-0e16-4f8c-82ae-53c33945ce5e None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:42.560893 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b90f7-0e16-4f8c-82ae-53c33945ce5e None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:42.561401 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b90f7-0e16-4f8c-82ae-53c33945ce5e None admin] PATH_INFO: `/v3/projects/b65984e2c7ae400c829003b7ab39d8e2` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:42.562906 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b90f7-0e16-4f8c-82ae-53c33945ce5e None admin] RBAC: Authorizing `identity:get_project(project_id=b65984e2c7ae400c829003b7ab39d8e2)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:42.565503 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b90f7-0e16-4f8c-82ae-53c33945ce5e None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:42.566051 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e55e4-d1c1-4967-b656-21f19c6c573b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:42.566912 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e55e4-d1c1-4967-b656-21f19c6c573b None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:42.567193 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e55e4-d1c1-4967-b656-21f19c6c573b None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:42.567468 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e55e4-d1c1-4967-b656-21f19c6c573b None admin] PATH_INFO: `/v3/projects/b65984e2c7ae400c829003b7ab39d8e2` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:42.568550 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 83/172] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:40:42 2022] GET /identity/v3/projects/b65984e2c7ae400c829003b7ab39d8e2 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:42.568655 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e55e4-d1c1-4967-b656-21f19c6c573b None admin] RBAC: Authorizing `identity:get_project(project_id=b65984e2c7ae400c829003b7ab39d8e2)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:42.569713 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b90f7-0e16-4f8c-82ae-53c33945ce5e None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:42.572010 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e55e4-d1c1-4967-b656-21f19c6c573b None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:42.572010 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 90/173] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:40:42 2022] GET /identity/v3/projects/b65984e2c7ae400c829003b7ab39d8e2 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:42.577950 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e55e4-d1c1-4967-b656-21f19c6c573b None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:42.699797 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e55e4-d1c1-4967-b656-21f19c6c573b None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:42.702250 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b90f7-0e16-4f8c-82ae-53c33945ce5e None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:42.739777 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a491a-68f6-42d9-8fe8-91815dfcc9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:42.741376 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a491a-68f6-42d9-8fe8-91815dfcc9ed None admin] REQUEST_METHOD: `PUT` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:42.741796 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a491a-68f6-42d9-8fe8-91815dfcc9ed None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:42.742199 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a491a-68f6-42d9-8fe8-91815dfcc9ed None admin] PATH_INFO: `/v3/projects/b65984e2c7ae400c829003b7ab39d8e2/users/2972d3b66934493ebf733765cee9f8fa/roles/ca508df0c9124b8d97536818daba3aee` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:42.744315 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a491a-68f6-42d9-8fe8-91815dfcc9ed None admin] RBAC: Authorizing `identity:create_grant(project_id=b65984e2c7ae400c829003b7ab39d8e2, user_id=2972d3b66934493ebf733765cee9f8fa, role_id=ca508df0c9124b8d97536818daba3aee)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:42.745955 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a491a-68f6-42d9-8fe8-91815dfcc9ed None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:42.764222 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e558627-dbfd-423c-9c4c-3a5248d9d764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:42.765459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e558627-dbfd-423c-9c4c-3a5248d9d764 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:42.765921 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e558627-dbfd-423c-9c4c-3a5248d9d764 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:42.766594 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e558627-dbfd-423c-9c4c-3a5248d9d764 None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:42.767945 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e558627-dbfd-423c-9c4c-3a5248d9d764 None admin] RBAC: Adding query filter params (name=member) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:42.768808 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e558627-dbfd-423c-9c4c-3a5248d9d764 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:42.771239 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e558627-dbfd-423c-9c4c-3a5248d9d764 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:42.783798 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 84/174] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Apr 30 20:40:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:42.785205 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e558627-dbfd-423c-9c4c-3a5248d9d764 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:42.826802 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 91/175] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Apr 30 20:40:42 2022] PUT /identity/v3/projects/b65984e2c7ae400c829003b7ab39d8e2/users/2972d3b66934493ebf733765cee9f8fa/roles/ca508df0c9124b8d97536818daba3aee => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:40:42.827726 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a491a-68f6-42d9-8fe8-91815dfcc9ed None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:42.942714 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e558627-dbfd-423c-9c4c-3a5248d9d764 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:42.978734 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ec5b8-027b-4642-96c2-4bad51cc8b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:42.979405 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ec5b8-027b-4642-96c2-4bad51cc8b9b None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:42.979690 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ec5b8-027b-4642-96c2-4bad51cc8b9b None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:42.979978 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ec5b8-027b-4642-96c2-4bad51cc8b9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:42.980835 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ec5b8-027b-4642-96c2-4bad51cc8b9b None admin] RBAC: Adding query filter params (role.id=f76bb9b1c47a4fbfa232de16b0b4a0d5, scope.project.id=b65984e2c7ae400c829003b7ab39d8e2, user.id=cecfe9bf486c4fba9525c86babed4c07) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:42.981177 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ec5b8-027b-4642-96c2-4bad51cc8b9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:42.982674 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ec5b8-027b-4642-96c2-4bad51cc8b9b None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:42.989514 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 85/176] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Apr 30 20:40:42 2022] GET /identity/v3/role_assignments?user.id=cecfe9bf486c4fba9525c86babed4c07&scope.project.id=b65984e2c7ae400c829003b7ab39d8e2&role.id=f76bb9b1c47a4fbfa232de16b0b4a0d5 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:43.017975 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a491a-68f6-42d9-8fe8-91815dfcc9ed None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:43.067642 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7cd05-d992-4e8a-aa9d-deff02c3bf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:43.068450 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7cd05-d992-4e8a-aa9d-deff02c3bf84 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:43.068724 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7cd05-d992-4e8a-aa9d-deff02c3bf84 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:43.069024 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7cd05-d992-4e8a-aa9d-deff02c3bf84 None admin] PATH_INFO: `/v3/users/cecfe9bf486c4fba9525c86babed4c07` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:43.070312 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7cd05-d992-4e8a-aa9d-deff02c3bf84 None admin] RBAC: Authorizing `identity:get_user(user_id=cecfe9bf486c4fba9525c86babed4c07)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:43.071814 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7cd05-d992-4e8a-aa9d-deff02c3bf84 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:43.073760 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 92/177] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Apr 30 20:40:42 2022] GET /identity/v3/users/cecfe9bf486c4fba9525c86babed4c07 => generated 275 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:43.079431 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ec5b8-027b-4642-96c2-4bad51cc8b9b None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:43.218178 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ec5b8-027b-4642-96c2-4bad51cc8b9b None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:43.259305 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf511c-f676-4b87-a558-111ceca2ff2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:43.259968 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf511c-f676-4b87-a558-111ceca2ff2e None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:43.260252 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf511c-f676-4b87-a558-111ceca2ff2e None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:43.260532 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf511c-f676-4b87-a558-111ceca2ff2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:43.355181 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf511c-f676-4b87-a558-111ceca2ff2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:43.356578 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf511c-f676-4b87-a558-111ceca2ff2e None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:43.471281 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 86/178] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:40:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:40:43.477716 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7cd05-d992-4e8a-aa9d-deff02c3bf84 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:43.612737 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7cd05-d992-4e8a-aa9d-deff02c3bf84 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:43.657686 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2addf-9938-49bd-90c6-ee2bb6f2004d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:43.659346 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2addf-9938-49bd-90c6-ee2bb6f2004d None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:43.659630 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2addf-9938-49bd-90c6-ee2bb6f2004d None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:43.659904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2addf-9938-49bd-90c6-ee2bb6f2004d None admin] PATH_INFO: `/v3/projects/4972609a22ba4b78bd1a06cf5b0712e2` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:43.661188 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2addf-9938-49bd-90c6-ee2bb6f2004d None admin] RBAC: Authorizing `identity:get_project(project_id=4972609a22ba4b78bd1a06cf5b0712e2)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:43.662661 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2addf-9938-49bd-90c6-ee2bb6f2004d None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:43.664364 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 93/179] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:40:43 2022] GET /identity/v3/projects/4972609a22ba4b78bd1a06cf5b0712e2 => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:43.670580 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf511c-f676-4b87-a558-111ceca2ff2e None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:43.802439 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf511c-f676-4b87-a558-111ceca2ff2e None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:43.854540 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ab340-d57d-48cd-b554-b2ebd54627a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:43.855209 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ab340-d57d-48cd-b554-b2ebd54627a7 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:43.855496 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ab340-d57d-48cd-b554-b2ebd54627a7 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:43.855771 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ab340-d57d-48cd-b554-b2ebd54627a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:43.856603 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ab340-d57d-48cd-b554-b2ebd54627a7 None admin] RBAC: Adding query filter params (role.id=375abc9f701c408ea332eaf2d8a2e086, scope.project.id=4972609a22ba4b78bd1a06cf5b0712e2, user.id=cecfe9bf486c4fba9525c86babed4c07) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:43.856937 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ab340-d57d-48cd-b554-b2ebd54627a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:43.858399 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ab340-d57d-48cd-b554-b2ebd54627a7 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:43.869470 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 87/180] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Apr 30 20:40:43 2022] GET /identity/v3/role_assignments?user.id=cecfe9bf486c4fba9525c86babed4c07&scope.project.id=4972609a22ba4b78bd1a06cf5b0712e2&role.id=375abc9f701c408ea332eaf2d8a2e086 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:44.384242 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd9be3-8dc8-472c-a2a4-c1354ca0422f None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:44.384518 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd9be3-8dc8-472c-a2a4-c1354ca0422f None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:44.384996 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd9be3-8dc8-472c-a2a4-c1354ca0422f None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:44.386498 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 94/181] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:44.391750 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803d036-116b-4d02-8670-5d475f229757 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:44.392193 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803d036-116b-4d02-8670-5d475f229757 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:44.392689 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803d036-116b-4d02-8670-5d475f229757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:44.407618 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b332b-edf7-439d-a127-698ef4856cb4 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:44.408239 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b332b-edf7-439d-a127-698ef4856cb4 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:44.409252 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b332b-edf7-439d-a127-698ef4856cb4 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:44.410850 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 95/182] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:44.414074 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-b803d036-116b-4d02-8670-5d475f229757 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:44.415244 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-b803d036-116b-4d02-8670-5d475f229757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:44.416615 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce48aad-b850-4016-866a-d6c32de49520 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:44.417153 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce48aad-b850-4016-866a-d6c32de49520 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:44.417653 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce48aad-b850-4016-866a-d6c32de49520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:44.435195 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-0ce48aad-b850-4016-866a-d6c32de49520 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:44.436669 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-0ce48aad-b850-4016-866a-d6c32de49520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:44.525125 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 96/183] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:40:44.532529 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 88/184] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:40:44.553205 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce48aad-b850-4016-866a-d6c32de49520 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:44.561666 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803d036-116b-4d02-8670-5d475f229757 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:44.662274 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce48aad-b850-4016-866a-d6c32de49520 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:44.685198 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803d036-116b-4d02-8670-5d475f229757 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:44.705036 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ae9f0-d388-4367-bdae-5209a6885837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:44.706581 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ae9f0-d388-4367-bdae-5209a6885837 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:44.706863 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ae9f0-d388-4367-bdae-5209a6885837 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:44.707139 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ae9f0-d388-4367-bdae-5209a6885837 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:44.721097 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ae9f0-d388-4367-bdae-5209a6885837 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:40:44.722291 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f654d1d-343f-45f7-9d85-8f91875b32c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:44.723298 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f654d1d-343f-45f7-9d85-8f91875b32c3 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:44.723786 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f654d1d-343f-45f7-9d85-8f91875b32c3 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:44.724278 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f654d1d-343f-45f7-9d85-8f91875b32c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:44.730645 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-1d5ae9f0-d388-4367-bdae-5209a6885837 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:40:44.730645 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:40:44.730645 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:40:44.730645 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:40:44.730645 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:40:44.730645 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:40:44.730645 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:40:44.730645 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:40:44.730645 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:40:44.730645 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:40:44.730645 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:40:44.730645 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:40:44.730645 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:40:44.730645 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:40:44.730645 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:40:44.730645 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:40:44.731518 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:40:44.731518 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:40:44.731518 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:40:44.731518 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:40:44.731518 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:40:44.731518 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:40:44.731518 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:40:44.731518 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:40:44.731518 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:40:44.731518 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:40:44.731518 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:40:44.731518 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:40:44.731518 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:40:44.731518 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:40:44.731518 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:40:44.731518 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:40:44.732293 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:40:44.732293 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:40:44.732293 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:40:44.732293 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:40:44.732293 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:40:44.732293 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:40:44.732293 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:40:44.732293 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:40:44.732293 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:40:44.732293 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:40:44.732293 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:40:44.732293 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:40:44.736990 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 97/185] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Apr 30 20:40:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:40:44.738219 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ae9f0-d388-4367-bdae-5209a6885837 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:44.742698 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f654d1d-343f-45f7-9d85-8f91875b32c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:40:44.751491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-4f654d1d-343f-45f7-9d85-8f91875b32c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:40:44.751491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:40:44.751491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:40:44.751491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:40:44.751491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:40:44.751491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:40:44.751491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:40:44.751491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:40:44.751491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:40:44.751491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:40:44.751491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:40:44.751491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:40:44.751491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:40:44.751491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:40:44.751491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:40:44.751491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:40:44.752422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:40:44.752422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:40:44.752422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:40:44.752422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:40:44.752422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:40:44.752422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:40:44.752422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:40:44.752422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:40:44.752422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:40:44.752422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:40:44.752422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:40:44.752422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:40:44.752422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:40:44.752422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:40:44.752422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:40:44.752422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:40:44.753440 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:40:44.753440 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:40:44.753440 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:40:44.753440 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:40:44.753440 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:40:44.753440 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:40:44.753440 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:40:44.753440 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:40:44.753440 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:40:44.753440 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:40:44.753440 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:40:44.753440 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:40:44.753440 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 89/186] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Apr 30 20:40:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:40:44.758614 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f654d1d-343f-45f7-9d85-8f91875b32c3 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:44.846138 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ae9f0-d388-4367-bdae-5209a6885837 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:44.868778 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f654d1d-343f-45f7-9d85-8f91875b32c3 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:44.881327 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36a57a-6888-4faa-9c0b-f839fa9579bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:44.882324 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36a57a-6888-4faa-9c0b-f839fa9579bc None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:44.882821 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36a57a-6888-4faa-9c0b-f839fa9579bc None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:44.883283 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36a57a-6888-4faa-9c0b-f839fa9579bc None admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:44.884285 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36a57a-6888-4faa-9c0b-f839fa9579bc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:44.884790 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36a57a-6888-4faa-9c0b-f839fa9579bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:44.886505 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36a57a-6888-4faa-9c0b-f839fa9579bc None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:44.895374 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 98/187] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:40:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:40:44.900845 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36a57a-6888-4faa-9c0b-f839fa9579bc None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:44.910066 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e6c7a-75e3-42ee-86b5-5889e4823a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:44.910733 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e6c7a-75e3-42ee-86b5-5889e4823a88 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:44.911011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e6c7a-75e3-42ee-86b5-5889e4823a88 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:44.911278 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e6c7a-75e3-42ee-86b5-5889e4823a88 None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:44.912021 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8e6c7a-75e3-42ee-86b5-5889e4823a88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:44.912383 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8e6c7a-75e3-42ee-86b5-5889e4823a88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:44.914204 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8e6c7a-75e3-42ee-86b5-5889e4823a88 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:44.924778 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 90/188] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:40:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:40:44.930433 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e6c7a-75e3-42ee-86b5-5889e4823a88 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:45.028961 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36a57a-6888-4faa-9c0b-f839fa9579bc None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:45.054829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e6c7a-75e3-42ee-86b5-5889e4823a88 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:45.071039 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c99d1-a41d-4b2e-925e-058051333b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:45.072768 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c99d1-a41d-4b2e-925e-058051333b22 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:45.073219 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c99d1-a41d-4b2e-925e-058051333b22 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:45.073636 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c99d1-a41d-4b2e-925e-058051333b22 None admin] PATH_INFO: `/v3/users/26b72eaac8cb4288b713347765f9fdab` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:45.090920 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c99d1-a41d-4b2e-925e-058051333b22 None admin] RBAC: Authorizing `identity:get_user(user_id=26b72eaac8cb4288b713347765f9fdab)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:45.093109 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c99d1-a41d-4b2e-925e-058051333b22 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:45.093713 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc5599-23ef-457d-a44c-c5884b1153e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:45.094711 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc5599-23ef-457d-a44c-c5884b1153e5 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:45.095090 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc5599-23ef-457d-a44c-c5884b1153e5 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:45.095508 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 99/189] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Apr 30 20:40:44 2022] GET /identity/v3/users/26b72eaac8cb4288b713347765f9fdab => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:45.100679 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc5599-23ef-457d-a44c-c5884b1153e5 None admin] PATH_INFO: `/v3/users/26b72eaac8cb4288b713347765f9fdab` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:45.101554 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc5599-23ef-457d-a44c-c5884b1153e5 None admin] RBAC: Authorizing `identity:get_user(user_id=26b72eaac8cb4288b713347765f9fdab)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:45.101940 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c99d1-a41d-4b2e-925e-058051333b22 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:45.103177 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc5599-23ef-457d-a44c-c5884b1153e5 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:45.105392 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 91/190] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Apr 30 20:40:44 2022] GET /identity/v3/users/26b72eaac8cb4288b713347765f9fdab => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:45.113907 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc5599-23ef-457d-a44c-c5884b1153e5 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:45.207321 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c99d1-a41d-4b2e-925e-058051333b22 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:45.215421 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc5599-23ef-457d-a44c-c5884b1153e5 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:45.242722 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34c066-2d8e-46e6-8969-a42c358b26da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:45.243372 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34c066-2d8e-46e6-8969-a42c358b26da None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:45.243678 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34c066-2d8e-46e6-8969-a42c358b26da None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:45.243940 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34c066-2d8e-46e6-8969-a42c358b26da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:45.249302 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaac75d-5a6e-4570-842b-640095214c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:45.250104 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaac75d-5a6e-4570-842b-640095214c99 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:45.250524 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaac75d-5a6e-4570-842b-640095214c99 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:45.250933 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaac75d-5a6e-4570-842b-640095214c99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:45.312083 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34c066-2d8e-46e6-8969-a42c358b26da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:45.313615 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34c066-2d8e-46e6-8969-a42c358b26da None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:45.320385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaac75d-5a6e-4570-842b-640095214c99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:45.322047 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaac75d-5a6e-4570-842b-640095214c99 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:45.412380 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 100/191] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:40:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:40:45.416971 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44e8ae-6cd2-4594-bfe2-c11bc72543de None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:45.416971 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44e8ae-6cd2-4594-bfe2-c11bc72543de None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:45.416971 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44e8ae-6cd2-4594-bfe2-c11bc72543de None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:45.416971 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 101/192] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:45.421171 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44e8ae-6cd2-4594-bfe2-c11bc72543de None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:45.431069 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 92/193] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:40:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:40:45.432047 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec08e31-4165-41e9-b39b-ee308944059a None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:45.432332 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec08e31-4165-41e9-b39b-ee308944059a None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:45.432607 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec08e31-4165-41e9-b39b-ee308944059a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:45.451534 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-4ec08e31-4165-41e9-b39b-ee308944059a None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:45.452696 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-4ec08e31-4165-41e9-b39b-ee308944059a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:45.523673 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 93/194] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:40:45.525677 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44e8ae-6cd2-4594-bfe2-c11bc72543de None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:45.529808 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec08e31-4165-41e9-b39b-ee308944059a None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:45.563058 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae94bf0-1422-4f8d-917a-7cb2af8d3e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:45.563960 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae94bf0-1422-4f8d-917a-7cb2af8d3e19 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:45.564241 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae94bf0-1422-4f8d-917a-7cb2af8d3e19 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:45.564891 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae94bf0-1422-4f8d-917a-7cb2af8d3e19 None admin] PATH_INFO: `/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:45.566099 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae94bf0-1422-4f8d-917a-7cb2af8d3e19 None admin] RBAC: Authorizing `identity:get_project(project_id=5141353bfd044a1ba7fb8ba70efe9a73)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:45.567564 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae94bf0-1422-4f8d-917a-7cb2af8d3e19 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:45.569388 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 102/195] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:40:45 2022] GET /identity/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:40:45.570144 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae94bf0-1422-4f8d-917a-7cb2af8d3e19 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:45.636740 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec08e31-4165-41e9-b39b-ee308944059a None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:45.673593 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c108f6-7e5b-4ba4-9c9b-71cc576318e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:45.675567 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c108f6-7e5b-4ba4-9c9b-71cc576318e6 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:45.675855 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c108f6-7e5b-4ba4-9c9b-71cc576318e6 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:45.676129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c108f6-7e5b-4ba4-9c9b-71cc576318e6 None admin] PATH_INFO: `/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:45.677278 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae94bf0-1422-4f8d-917a-7cb2af8d3e19 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:45.677708 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c108f6-7e5b-4ba4-9c9b-71cc576318e6 None admin] RBAC: Authorizing `identity:get_project(project_id=5141353bfd044a1ba7fb8ba70efe9a73)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:45.678954 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c108f6-7e5b-4ba4-9c9b-71cc576318e6 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:45.681628 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 94/196] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:40:45 2022] GET /identity/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:45.685808 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c108f6-7e5b-4ba4-9c9b-71cc576318e6 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:45.712743 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c456c30-913f-431d-803b-e1aec622f19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:45.713830 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c456c30-913f-431d-803b-e1aec622f19a None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:45.714112 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c456c30-913f-431d-803b-e1aec622f19a None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:45.714384 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c456c30-913f-431d-803b-e1aec622f19a None admin] PATH_INFO: `/v3/domains/default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:45.715540 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c456c30-913f-431d-803b-e1aec622f19a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:45.717008 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c456c30-913f-431d-803b-e1aec622f19a None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:45.718776 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 103/197] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:40:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:45.719508 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c456c30-913f-431d-803b-e1aec622f19a None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:45.786337 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c108f6-7e5b-4ba4-9c9b-71cc576318e6 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:45.822924 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c456c30-913f-431d-803b-e1aec622f19a None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:45.823060 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b57331-7e64-4d6d-a045-0941749cd6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:45.823701 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b57331-7e64-4d6d-a045-0941749cd6fb None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:45.823989 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b57331-7e64-4d6d-a045-0941749cd6fb None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:45.824266 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b57331-7e64-4d6d-a045-0941749cd6fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:45.825116 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b57331-7e64-4d6d-a045-0941749cd6fb None admin] RBAC: Adding query filter params (role.id=f76bb9b1c47a4fbfa232de16b0b4a0d5, scope.project.id=5141353bfd044a1ba7fb8ba70efe9a73, user.id=26b72eaac8cb4288b713347765f9fdab) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:45.825426 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b57331-7e64-4d6d-a045-0941749cd6fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:45.826854 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b57331-7e64-4d6d-a045-0941749cd6fb None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:45.832663 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 95/198] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Apr 30 20:40:45 2022] GET /identity/v3/role_assignments?user.id=26b72eaac8cb4288b713347765f9fdab&scope.project.id=5141353bfd044a1ba7fb8ba70efe9a73&role.id=f76bb9b1c47a4fbfa232de16b0b4a0d5 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:45.833463 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b57331-7e64-4d6d-a045-0941749cd6fb None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:45.869003 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db288b17-2c9e-43c0-9272-5cf538687672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:45.869676 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db288b17-2c9e-43c0-9272-5cf538687672 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:45.869966 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db288b17-2c9e-43c0-9272-5cf538687672 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:45.870244 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db288b17-2c9e-43c0-9272-5cf538687672 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:45.871096 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db288b17-2c9e-43c0-9272-5cf538687672 None admin] RBAC: Adding query filter params (role.id=31b3f11a82cd4cd2823e88aa0e931323, scope.project.id=5141353bfd044a1ba7fb8ba70efe9a73, user.id=26b72eaac8cb4288b713347765f9fdab) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:45.871408 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db288b17-2c9e-43c0-9272-5cf538687672 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:45.872967 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db288b17-2c9e-43c0-9272-5cf538687672 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:45.879693 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 104/199] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Apr 30 20:40:45 2022] GET /identity/v3/role_assignments?user.id=26b72eaac8cb4288b713347765f9fdab&scope.project.id=5141353bfd044a1ba7fb8ba70efe9a73&role.id=31b3f11a82cd4cd2823e88aa0e931323 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:45.881390 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374ecca-f904-479a-8a8f-f711223f389c None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:45.881706 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374ecca-f904-479a-8a8f-f711223f389c None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:45.881960 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374ecca-f904-479a-8a8f-f711223f389c None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:45.883485 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 105/200] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:45.889371 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c565d-4254-4a64-84f5-ad833f489401 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:45.889736 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c565d-4254-4a64-84f5-ad833f489401 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:45.889925 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c565d-4254-4a64-84f5-ad833f489401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:45.907133 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-260c565d-4254-4a64-84f5-ad833f489401 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:45.908874 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-260c565d-4254-4a64-84f5-ad833f489401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:45.944810 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b57331-7e64-4d6d-a045-0941749cd6fb None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:45.989216 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb0d5e-8779-4f79-9837-c9ab63b0c362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:45.989901 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb0d5e-8779-4f79-9837-c9ab63b0c362 None admin] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:45.990181 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb0d5e-8779-4f79-9837-c9ab63b0c362 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:45.990454 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb0d5e-8779-4f79-9837-c9ab63b0c362 None admin] PATH_INFO: `/v3/users` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:45.991169 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb0d5e-8779-4f79-9837-c9ab63b0c362 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:45.992645 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb0d5e-8779-4f79-9837-c9ab63b0c362 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:46.005765 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 106/201] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:40:46.031494 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c565d-4254-4a64-84f5-ad833f489401 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:46.103337 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 96/202] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Apr 30 20:40:45 2022] POST /identity/v3/users => generated 297 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:40:46.152393 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c565d-4254-4a64-84f5-ad833f489401 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:46.193320 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24816056-ebab-47ae-ae04-3a571cba45a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:46.194607 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24816056-ebab-47ae-ae04-3a571cba45a4 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:46.195168 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24816056-ebab-47ae-ae04-3a571cba45a4 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:46.195647 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24816056-ebab-47ae-ae04-3a571cba45a4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:46.208307 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24816056-ebab-47ae-ae04-3a571cba45a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:40:46.216834 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-24816056-ebab-47ae-ae04-3a571cba45a4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 30 20:40:46.216834 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:40:46.216834 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:40:46.216834 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:40:46.216834 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:40:46.216834 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:40:46.216834 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:40:46.216834 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:40:46.216834 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:40:46.216834 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:40:46.216834 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:40:46.216834 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:40:46.216834 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:40:46.216834 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:40:46.216834 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:40:46.216834 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:40:46.217792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:40:46.217792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:40:46.217792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:40:46.217792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:40:46.217792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:40:46.217792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:40:46.217792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:40:46.217792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:40:46.217792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:40:46.217792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:40:46.217792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:40:46.217792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:40:46.217792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:40:46.217792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:40:46.217792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:40:46.217792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:40:46.218601 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:40:46.218601 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:40:46.218601 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:40:46.218601 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:40:46.218601 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:40:46.218601 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:40:46.218601 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:40:46.218601 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:40:46.218601 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:40:46.218601 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:40:46.218601 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Apr 30 20:40:46.218601 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:40:46.221457 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 107/203] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:40:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:40:46.230086 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb0d5e-8779-4f79-9837-c9ab63b0c362 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:46.336812 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb0d5e-8779-4f79-9837-c9ab63b0c362 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:46.371288 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8db737-01fd-4956-b48b-b7c15cc795da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:46.371897 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8db737-01fd-4956-b48b-b7c15cc795da None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:46.372198 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8db737-01fd-4956-b48b-b7c15cc795da None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:46.372456 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8db737-01fd-4956-b48b-b7c15cc795da None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:46.373234 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8db737-01fd-4956-b48b-b7c15cc795da None admin] RBAC: Adding query filter params (name=reader) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:46.373541 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8db737-01fd-4956-b48b-b7c15cc795da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:46.374941 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8db737-01fd-4956-b48b-b7c15cc795da None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:46.384952 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 97/204] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Apr 30 20:40:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:46.390425 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24816056-ebab-47ae-ae04-3a571cba45a4 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:46.510413 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24816056-ebab-47ae-ae04-3a571cba45a4 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:46.556462 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba0f22-0b21-4203-b188-9be45f4dd639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:46.557369 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba0f22-0b21-4203-b188-9be45f4dd639 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:46.557652 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba0f22-0b21-4203-b188-9be45f4dd639 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:46.557921 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba0f22-0b21-4203-b188-9be45f4dd639 None admin] PATH_INFO: `/v3/users/2972d3b66934493ebf733765cee9f8fa` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:46.559119 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba0f22-0b21-4203-b188-9be45f4dd639 None admin] RBAC: Authorizing `identity:get_user(user_id=2972d3b66934493ebf733765cee9f8fa)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:46.560586 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba0f22-0b21-4203-b188-9be45f4dd639 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:46.562619 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 108/205] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Apr 30 20:40:46 2022] GET /identity/v3/users/2972d3b66934493ebf733765cee9f8fa => generated 289 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:46.567768 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8db737-01fd-4956-b48b-b7c15cc795da None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:46.671945 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8db737-01fd-4956-b48b-b7c15cc795da None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:46.707348 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908139b-8ec5-42be-a24d-2bad54a0c9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:46.708006 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908139b-8ec5-42be-a24d-2bad54a0c9b5 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:46.708287 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908139b-8ec5-42be-a24d-2bad54a0c9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:46.708560 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908139b-8ec5-42be-a24d-2bad54a0c9b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:46.778039 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908139b-8ec5-42be-a24d-2bad54a0c9b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:46.779508 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908139b-8ec5-42be-a24d-2bad54a0c9b5 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:46.892267 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 98/206] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:40:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 30 20:40:46.898184 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba0f22-0b21-4203-b188-9be45f4dd639 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:46.998447 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba0f22-0b21-4203-b188-9be45f4dd639 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:47.044674 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ff871-8a48-4ed9-b168-940c1d0f84d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:47.045555 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ff871-8a48-4ed9-b168-940c1d0f84d4 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:47.045834 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ff871-8a48-4ed9-b168-940c1d0f84d4 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:47.046103 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ff871-8a48-4ed9-b168-940c1d0f84d4 None admin] PATH_INFO: `/v3/projects/b65984e2c7ae400c829003b7ab39d8e2` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:47.049964 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ff871-8a48-4ed9-b168-940c1d0f84d4 None admin] RBAC: Authorizing `identity:get_project(project_id=b65984e2c7ae400c829003b7ab39d8e2)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:47.051429 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ff871-8a48-4ed9-b168-940c1d0f84d4 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:47.053135 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 109/207] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:40:46 2022] GET /identity/v3/projects/b65984e2c7ae400c829003b7ab39d8e2 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:47.059078 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908139b-8ec5-42be-a24d-2bad54a0c9b5 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:47.179664 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908139b-8ec5-42be-a24d-2bad54a0c9b5 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:47.219424 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903602a3-8917-4c68-bdb3-23257e49f219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:47.220092 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903602a3-8917-4c68-bdb3-23257e49f219 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:47.220371 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903602a3-8917-4c68-bdb3-23257e49f219 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:47.220648 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903602a3-8917-4c68-bdb3-23257e49f219 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:47.222160 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903602a3-8917-4c68-bdb3-23257e49f219 None admin] RBAC: Adding query filter params (role.id=ca508df0c9124b8d97536818daba3aee, scope.project.id=b65984e2c7ae400c829003b7ab39d8e2, user.id=2972d3b66934493ebf733765cee9f8fa) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:47.222519 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903602a3-8917-4c68-bdb3-23257e49f219 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:47.223949 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903602a3-8917-4c68-bdb3-23257e49f219 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:47.231520 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 99/208] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Apr 30 20:40:47 2022] GET /identity/v3/role_assignments?user.id=2972d3b66934493ebf733765cee9f8fa&scope.project.id=b65984e2c7ae400c829003b7ab39d8e2&role.id=ca508df0c9124b8d97536818daba3aee => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:48.435364 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82bd14-89c1-4d66-b1c2-fc7c65eca5f3 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:48.436104 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82bd14-89c1-4d66-b1c2-fc7c65eca5f3 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:48.436104 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82bd14-89c1-4d66-b1c2-fc7c65eca5f3 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:48.437321 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 110/209] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:48.443125 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc955ce7-bf5f-4cd5-a31c-847115a620f6 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:48.443621 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc955ce7-bf5f-4cd5-a31c-847115a620f6 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:48.443792 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc955ce7-bf5f-4cd5-a31c-847115a620f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:48.461997 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-fc955ce7-bf5f-4cd5-a31c-847115a620f6 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:48.463203 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-fc955ce7-bf5f-4cd5-a31c-847115a620f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:48.495160 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5adde-3a87-4038-b000-e08bc7f33102 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:48.495481 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5adde-3a87-4038-b000-e08bc7f33102 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:48.495722 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5adde-3a87-4038-b000-e08bc7f33102 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:48.497111 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 111/210] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:40:48.503181 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab8679-d74a-4188-9a99-2a88a6e0e5e2 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:48.503778 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab8679-d74a-4188-9a99-2a88a6e0e5e2 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:48.504258 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab8679-d74a-4188-9a99-2a88a6e0e5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:48.525349 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-1fab8679-d74a-4188-9a99-2a88a6e0e5e2 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:48.526849 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-1fab8679-d74a-4188-9a99-2a88a6e0e5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:48.541531 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 100/211] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:40:48.578015 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc955ce7-bf5f-4cd5-a31c-847115a620f6 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:48.639605 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 112/212] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:40:48.663818 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab8679-d74a-4188-9a99-2a88a6e0e5e2 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:48.726744 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc955ce7-bf5f-4cd5-a31c-847115a620f6 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:48.765598 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab8679-d74a-4188-9a99-2a88a6e0e5e2 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:48.772272 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec50d1-ada4-4995-b489-5f77c73bef64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:48.773369 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec50d1-ada4-4995-b489-5f77c73bef64 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:48.773854 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec50d1-ada4-4995-b489-5f77c73bef64 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:48.774729 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec50d1-ada4-4995-b489-5f77c73bef64 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:48.788774 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec50d1-ada4-4995-b489-5f77c73bef64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:40:48.800320 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-f8ec50d1-ada4-4995-b489-5f77c73bef64 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:40:48.800320 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:40:48.800320 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:40:48.800320 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:40:48.800320 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:40:48.800320 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:40:48.800320 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:40:48.800320 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:40:48.800320 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:40:48.800320 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:40:48.800320 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:40:48.800320 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:40:48.800320 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:40:48.800320 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:40:48.800320 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:40:48.800320 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:40:48.801256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:40:48.801256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:40:48.801256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:40:48.801256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:40:48.801256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:40:48.801256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:40:48.801256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:40:48.801256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:40:48.801256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:40:48.801256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:40:48.801256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:40:48.801256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:40:48.801256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:40:48.801256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:40:48.801256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:40:48.801256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:40:48.802051 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:40:48.802051 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:40:48.802051 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:40:48.802051 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:40:48.802051 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:40:48.802051 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:40:48.802051 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:40:48.802051 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:40:48.802051 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:40:48.802051 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:40:48.802051 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:40:48.802051 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:40:48.802643 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557d7ad-db7c-4f6e-b387-c7e680f7bf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:48.802643 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557d7ad-db7c-4f6e-b387-c7e680f7bf46 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:48.803152 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557d7ad-db7c-4f6e-b387-c7e680f7bf46 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:48.803713 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557d7ad-db7c-4f6e-b387-c7e680f7bf46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:48.804668 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 101/213] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Apr 30 20:40:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:40:48.815091 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec50d1-ada4-4995-b489-5f77c73bef64 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:48.829150 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5557d7ad-db7c-4f6e-b387-c7e680f7bf46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:40:48.840189 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-5557d7ad-db7c-4f6e-b387-c7e680f7bf46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:40:48.840189 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:40:48.840189 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:40:48.840189 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:40:48.840189 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:40:48.840189 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:40:48.840189 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:40:48.840189 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:40:48.840189 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:40:48.840189 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:40:48.840189 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:40:48.840189 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:40:48.840189 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:40:48.840189 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:40:48.840189 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:40:48.840189 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:40:48.841150 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:40:48.841150 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:40:48.841150 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:40:48.841150 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:40:48.841150 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:40:48.841150 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:40:48.841150 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:40:48.841150 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:40:48.841150 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:40:48.841150 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:40:48.841150 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:40:48.841150 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:40:48.841150 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:40:48.841150 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:40:48.841150 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:40:48.841150 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:40:48.841953 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:40:48.841953 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:40:48.841953 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:40:48.841953 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:40:48.841953 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:40:48.841953 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:40:48.841953 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:40:48.841953 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:40:48.841953 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:40:48.841953 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:40:48.841953 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:40:48.841953 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:40:48.844782 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 113/214] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Apr 30 20:40:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:40:48.852546 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557d7ad-db7c-4f6e-b387-c7e680f7bf46 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:48.949417 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec50d1-ada4-4995-b489-5f77c73bef64 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:48.985035 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326dda8a-4447-4e1c-bb22-17ed97f4b8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:48.985637 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326dda8a-4447-4e1c-bb22-17ed97f4b8a2 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:48.985918 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326dda8a-4447-4e1c-bb22-17ed97f4b8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:48.986192 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326dda8a-4447-4e1c-bb22-17ed97f4b8a2 None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:48.987516 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326dda8a-4447-4e1c-bb22-17ed97f4b8a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:48.987623 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326dda8a-4447-4e1c-bb22-17ed97f4b8a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:48.989055 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326dda8a-4447-4e1c-bb22-17ed97f4b8a2 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:48.990862 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557d7ad-db7c-4f6e-b387-c7e680f7bf46 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:48.997503 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 102/215] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:40:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:49.003904 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326dda8a-4447-4e1c-bb22-17ed97f4b8a2 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:49.032672 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04858a-055f-4137-9efb-4a42f5572326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:49.033879 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04858a-055f-4137-9efb-4a42f5572326 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:49.034805 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04858a-055f-4137-9efb-4a42f5572326 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:49.035517 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04858a-055f-4137-9efb-4a42f5572326 None admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:49.036479 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04858a-055f-4137-9efb-4a42f5572326 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:49.037002 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04858a-055f-4137-9efb-4a42f5572326 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:49.039619 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04858a-055f-4137-9efb-4a42f5572326 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:49.048495 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 114/216] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:40:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:49.051074 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c380d1-52c4-47a7-9a42-552bf7c5dbd2 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:49.051368 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c380d1-52c4-47a7-9a42-552bf7c5dbd2 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:49.051643 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c380d1-52c4-47a7-9a42-552bf7c5dbd2 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:49.053060 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 115/217] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:49.057567 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c380d1-52c4-47a7-9a42-552bf7c5dbd2 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:49.109329 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326dda8a-4447-4e1c-bb22-17ed97f4b8a2 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:49.139942 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198bdf8-9191-45bc-ba07-81861bde5c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:49.140804 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198bdf8-9191-45bc-ba07-81861bde5c4c None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:49.141120 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198bdf8-9191-45bc-ba07-81861bde5c4c None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:49.141395 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198bdf8-9191-45bc-ba07-81861bde5c4c None admin] PATH_INFO: `/v3/users/26b72eaac8cb4288b713347765f9fdab` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:49.143286 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8198bdf8-9191-45bc-ba07-81861bde5c4c None admin] RBAC: Authorizing `identity:get_user(user_id=26b72eaac8cb4288b713347765f9fdab)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:49.144833 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8198bdf8-9191-45bc-ba07-81861bde5c4c None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:49.146473 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 103/218] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Apr 30 20:40:49 2022] GET /identity/v3/users/26b72eaac8cb4288b713347765f9fdab => generated 283 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:49.147735 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7492eb-3fbd-4d55-b1d5-6447a5072e1f None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:49.148031 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7492eb-3fbd-4d55-b1d5-6447a5072e1f None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:49.148307 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7492eb-3fbd-4d55-b1d5-6447a5072e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:49.156345 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c380d1-52c4-47a7-9a42-552bf7c5dbd2 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:49.164107 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-5a7492eb-3fbd-4d55-b1d5-6447a5072e1f None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:49.165315 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-5a7492eb-3fbd-4d55-b1d5-6447a5072e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:49.188715 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463fe96-ea0c-4d5d-90c2-ae3fd39a4360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:49.189793 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463fe96-ea0c-4d5d-90c2-ae3fd39a4360 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:49.190077 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463fe96-ea0c-4d5d-90c2-ae3fd39a4360 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:49.190354 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463fe96-ea0c-4d5d-90c2-ae3fd39a4360 None admin] PATH_INFO: `/v3/users/26b72eaac8cb4288b713347765f9fdab` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:49.191531 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c463fe96-ea0c-4d5d-90c2-ae3fd39a4360 None admin] RBAC: Authorizing `identity:get_user(user_id=26b72eaac8cb4288b713347765f9fdab)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:49.193016 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c463fe96-ea0c-4d5d-90c2-ae3fd39a4360 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:49.194682 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 116/219] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Apr 30 20:40:49 2022] GET /identity/v3/users/26b72eaac8cb4288b713347765f9fdab => generated 283 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:49.198227 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef045b1-dbd7-42a7-b204-92239864f145 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:49.198516 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef045b1-dbd7-42a7-b204-92239864f145 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:49.198796 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef045b1-dbd7-42a7-b204-92239864f145 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:49.200144 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 117/220] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:49.201707 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef045b1-dbd7-42a7-b204-92239864f145 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:49.229880 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 104/221] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:40:49.230730 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7492eb-3fbd-4d55-b1d5-6447a5072e1f None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:49.300275 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef045b1-dbd7-42a7-b204-92239864f145 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:49.324021 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7492eb-3fbd-4d55-b1d5-6447a5072e1f None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:49.332452 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10f0f4-2d32-4648-8a66-7101a1e1780f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:49.333333 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10f0f4-2d32-4648-8a66-7101a1e1780f None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:49.333615 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10f0f4-2d32-4648-8a66-7101a1e1780f None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:49.333886 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10f0f4-2d32-4648-8a66-7101a1e1780f None admin] PATH_INFO: `/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:49.337470 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10f0f4-2d32-4648-8a66-7101a1e1780f None admin] RBAC: Authorizing `identity:get_project(project_id=5141353bfd044a1ba7fb8ba70efe9a73)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:49.337470 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10f0f4-2d32-4648-8a66-7101a1e1780f None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:49.343272 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 118/222] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:40:49 2022] GET /identity/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73 => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:49.343272 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18507ef4-47c0-4423-b42f-e80cd3fc674d None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:49.343272 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18507ef4-47c0-4423-b42f-e80cd3fc674d None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:49.343272 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18507ef4-47c0-4423-b42f-e80cd3fc674d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:49.358569 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-18507ef4-47c0-4423-b42f-e80cd3fc674d None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:49.359795 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-18507ef4-47c0-4423-b42f-e80cd3fc674d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:49.363396 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e21955-e7d1-4b40-bf34-1780f2b6ff3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:49.364249 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e21955-e7d1-4b40-bf34-1780f2b6ff3e None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:49.364525 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e21955-e7d1-4b40-bf34-1780f2b6ff3e None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:49.364793 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e21955-e7d1-4b40-bf34-1780f2b6ff3e None admin] PATH_INFO: `/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:49.365991 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e21955-e7d1-4b40-bf34-1780f2b6ff3e None admin] RBAC: Authorizing `identity:get_project(project_id=5141353bfd044a1ba7fb8ba70efe9a73)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:49.367433 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e21955-e7d1-4b40-bf34-1780f2b6ff3e None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:49.369218 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 105/223] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:40:49 2022] GET /identity/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:49.369906 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e21955-e7d1-4b40-bf34-1780f2b6ff3e None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:49.423926 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 119/224] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:40:49.433149 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18507ef4-47c0-4423-b42f-e80cd3fc674d None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:49.466846 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e21955-e7d1-4b40-bf34-1780f2b6ff3e None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:49.498837 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b17b8e-5e11-42da-83e7-e0e00cc514d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:49.499623 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b17b8e-5e11-42da-83e7-e0e00cc514d3 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:49.499897 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b17b8e-5e11-42da-83e7-e0e00cc514d3 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:49.500164 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b17b8e-5e11-42da-83e7-e0e00cc514d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:49.510261 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b17b8e-5e11-42da-83e7-e0e00cc514d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:40:49.518338 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-b7b17b8e-5e11-42da-83e7-e0e00cc514d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:40:49.518338 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:40:49.518338 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:40:49.518338 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:40:49.518338 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:40:49.518338 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:40:49.518338 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:40:49.518338 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:40:49.518338 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:40:49.518338 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:40:49.518338 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:40:49.518338 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:40:49.518338 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:40:49.518338 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:40:49.518338 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:40:49.518338 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:40:49.519370 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:40:49.519370 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:40:49.519370 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:40:49.519370 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:40:49.519370 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:40:49.519370 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:40:49.519370 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:40:49.519370 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:40:49.519370 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:40:49.519370 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:40:49.519370 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:40:49.519370 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:40:49.519370 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:40:49.519370 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:40:49.519370 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:40:49.519370 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:40:49.520201 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:40:49.520201 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:40:49.520201 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:40:49.520201 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:40:49.520201 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:40:49.520201 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:40:49.520201 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:40:49.520201 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:40:49.520201 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:40:49.520201 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:40:49.520201 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:40:49.520201 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:40:49.520201 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 106/225] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:40:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:40:49.521982 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b17b8e-5e11-42da-83e7-e0e00cc514d3 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:49.526184 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18507ef4-47c0-4423-b42f-e80cd3fc674d None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:49.558195 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22adfa46-4355-464e-b754-c9c0b68d8b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:49.559003 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adfa46-4355-464e-b754-c9c0b68d8b03 None admin] REQUEST_METHOD: `PUT` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:49.559280 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adfa46-4355-464e-b754-c9c0b68d8b03 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:49.559548 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adfa46-4355-464e-b754-c9c0b68d8b03 None admin] PATH_INFO: `/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73/users/26b72eaac8cb4288b713347765f9fdab/roles/f76bb9b1c47a4fbfa232de16b0b4a0d5` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:49.561891 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22adfa46-4355-464e-b754-c9c0b68d8b03 None admin] RBAC: Authorizing `identity:create_grant(project_id=5141353bfd044a1ba7fb8ba70efe9a73, user_id=26b72eaac8cb4288b713347765f9fdab, role_id=f76bb9b1c47a4fbfa232de16b0b4a0d5)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:49.563412 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22adfa46-4355-464e-b754-c9c0b68d8b03 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:49.614936 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 120/226] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Apr 30 20:40:49 2022] PUT /identity/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73/users/26b72eaac8cb4288b713347765f9fdab/roles/f76bb9b1c47a4fbfa232de16b0b4a0d5 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:40:49.626851 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22adfa46-4355-464e-b754-c9c0b68d8b03 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:49.627510 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b17b8e-5e11-42da-83e7-e0e00cc514d3 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:49.656814 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b363e6-b606-451a-8c9e-a957700f7b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:49.657749 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b363e6-b606-451a-8c9e-a957700f7b5a None admin] REQUEST_METHOD: `PUT` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:49.658030 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b363e6-b606-451a-8c9e-a957700f7b5a None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:49.658463 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b363e6-b606-451a-8c9e-a957700f7b5a None admin] PATH_INFO: `/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73/users/26b72eaac8cb4288b713347765f9fdab/roles/31b3f11a82cd4cd2823e88aa0e931323` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:49.660940 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b363e6-b606-451a-8c9e-a957700f7b5a None admin] RBAC: Authorizing `identity:create_grant(project_id=5141353bfd044a1ba7fb8ba70efe9a73, user_id=26b72eaac8cb4288b713347765f9fdab, role_id=31b3f11a82cd4cd2823e88aa0e931323)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:49.662415 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b363e6-b606-451a-8c9e-a957700f7b5a None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:49.736249 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22adfa46-4355-464e-b754-c9c0b68d8b03 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:49.753589 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 107/227] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Apr 30 20:40:49 2022] PUT /identity/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73/users/26b72eaac8cb4288b713347765f9fdab/roles/31b3f11a82cd4cd2823e88aa0e931323 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:40:49.765311 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b363e6-b606-451a-8c9e-a957700f7b5a None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:49.779914 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741ff42-74d4-438c-a41e-be17449734b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:49.780806 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741ff42-74d4-438c-a41e-be17449734b0 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:49.783441 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741ff42-74d4-438c-a41e-be17449734b0 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:49.783441 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741ff42-74d4-438c-a41e-be17449734b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:49.783441 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741ff42-74d4-438c-a41e-be17449734b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:49.784955 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741ff42-74d4-438c-a41e-be17449734b0 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:49.786830 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 121/228] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:40:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:49.793027 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741ff42-74d4-438c-a41e-be17449734b0 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:49.895200 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b363e6-b606-451a-8c9e-a957700f7b5a None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:49.931760 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9944fb4-fcea-4009-8251-aa0e7c4044bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:49.932746 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9944fb4-fcea-4009-8251-aa0e7c4044bf None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:49.933126 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741ff42-74d4-438c-a41e-be17449734b0 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:49.933672 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9944fb4-fcea-4009-8251-aa0e7c4044bf None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:49.934331 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9944fb4-fcea-4009-8251-aa0e7c4044bf None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:49.935884 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9944fb4-fcea-4009-8251-aa0e7c4044bf None admin] RBAC: Adding query filter params (name=member) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:49.936619 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9944fb4-fcea-4009-8251-aa0e7c4044bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:49.938324 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9944fb4-fcea-4009-8251-aa0e7c4044bf None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:49.948239 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 108/229] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Apr 30 20:40:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:49.953923 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9944fb4-fcea-4009-8251-aa0e7c4044bf None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:49.973608 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177b23f-0a2e-4abd-8218-5148334858f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:49.974576 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177b23f-0a2e-4abd-8218-5148334858f3 None admin] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:49.974932 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177b23f-0a2e-4abd-8218-5148334858f3 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:49.975283 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177b23f-0a2e-4abd-8218-5148334858f3 None admin] PATH_INFO: `/v3/users` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:49.976333 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177b23f-0a2e-4abd-8218-5148334858f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:49.977867 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177b23f-0a2e-4abd-8218-5148334858f3 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:50.057842 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9944fb4-fcea-4009-8251-aa0e7c4044bf None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:50.070893 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 122/230] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Apr 30 20:40:49 2022] POST /identity/v3/users => generated 297 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 20:40:50.104641 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8a030-d8b2-4654-811d-927ea2fc1963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:50.105919 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8a030-d8b2-4654-811d-927ea2fc1963 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:50.106406 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8a030-d8b2-4654-811d-927ea2fc1963 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:50.106883 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8a030-d8b2-4654-811d-927ea2fc1963 None admin] PATH_INFO: `/v3/users/69d105124f354de09d9e704d45c92f64` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:50.126207 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8a030-d8b2-4654-811d-927ea2fc1963 None admin] RBAC: Authorizing `identity:get_user(user_id=69d105124f354de09d9e704d45c92f64)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:50.128802 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8a030-d8b2-4654-811d-927ea2fc1963 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:50.130853 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 109/231] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Apr 30 20:40:49 2022] GET /identity/v3/users/69d105124f354de09d9e704d45c92f64 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:50.136633 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177b23f-0a2e-4abd-8218-5148334858f3 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:50.252984 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177b23f-0a2e-4abd-8218-5148334858f3 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:50.286856 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9d72f-c962-4243-ad1d-3c205dffa598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:50.287506 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9d72f-c962-4243-ad1d-3c205dffa598 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:50.287785 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9d72f-c962-4243-ad1d-3c205dffa598 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:50.288057 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9d72f-c962-4243-ad1d-3c205dffa598 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:50.357115 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff9d72f-c962-4243-ad1d-3c205dffa598 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:50.358914 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff9d72f-c962-4243-ad1d-3c205dffa598 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:50.467383 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 123/232] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:40:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:40:50.472688 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8a030-d8b2-4654-811d-927ea2fc1963 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:50.589535 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8a030-d8b2-4654-811d-927ea2fc1963 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:50.624237 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0803c-09cf-4e6a-953f-6e9d20c8abba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:50.625042 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0803c-09cf-4e6a-953f-6e9d20c8abba None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:50.625324 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0803c-09cf-4e6a-953f-6e9d20c8abba None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:50.625596 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0803c-09cf-4e6a-953f-6e9d20c8abba None admin] PATH_INFO: `/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:50.626791 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0803c-09cf-4e6a-953f-6e9d20c8abba None admin] RBAC: Authorizing `identity:get_project(project_id=5141353bfd044a1ba7fb8ba70efe9a73)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:50.629283 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0803c-09cf-4e6a-953f-6e9d20c8abba None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:50.630996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 110/233] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:40:50 2022] GET /identity/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:50.636985 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9d72f-c962-4243-ad1d-3c205dffa598 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:50.740006 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9d72f-c962-4243-ad1d-3c205dffa598 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:50.774676 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a944e-3f0d-45b8-82e7-455482422798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:50.775330 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a944e-3f0d-45b8-82e7-455482422798 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:50.775609 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a944e-3f0d-45b8-82e7-455482422798 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:50.775883 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a944e-3f0d-45b8-82e7-455482422798 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:50.776697 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a944e-3f0d-45b8-82e7-455482422798 None admin] RBAC: Adding query filter params (role.id=375abc9f701c408ea332eaf2d8a2e086, scope.project.id=5141353bfd044a1ba7fb8ba70efe9a73, user.id=69d105124f354de09d9e704d45c92f64) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:50.777035 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a944e-3f0d-45b8-82e7-455482422798 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:50.778482 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a944e-3f0d-45b8-82e7-455482422798 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:50.784079 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 124/234] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Apr 30 20:40:50 2022] GET /identity/v3/role_assignments?user.id=69d105124f354de09d9e704d45c92f64&scope.project.id=5141353bfd044a1ba7fb8ba70efe9a73&role.id=375abc9f701c408ea332eaf2d8a2e086 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:52.471011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1083d0a-d930-4fa9-a755-332fdb10c1ac None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:52.471976 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1083d0a-d930-4fa9-a755-332fdb10c1ac None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:52.471976 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1083d0a-d930-4fa9-a755-332fdb10c1ac None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:52.473120 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 111/235] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:52.485751 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503e49f-3edc-403c-96a8-4c3c69c2c008 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:52.486425 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503e49f-3edc-403c-96a8-4c3c69c2c008 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:52.486425 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503e49f-3edc-403c-96a8-4c3c69c2c008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:52.509921 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-c503e49f-3edc-403c-96a8-4c3c69c2c008 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:52.511112 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-c503e49f-3edc-403c-96a8-4c3c69c2c008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:52.591245 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 125/236] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:40:52.634127 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1083d0a-d930-4fa9-a755-332fdb10c1ac None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:52.687462 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4794e6-3d9f-47c7-9f99-7ee78ddf9125 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:52.687954 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4794e6-3d9f-47c7-9f99-7ee78ddf9125 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:52.688341 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4794e6-3d9f-47c7-9f99-7ee78ddf9125 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:52.690413 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 126/237] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:52.695943 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2abcbf-a780-47bd-8a4d-d092679e550f None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:52.696346 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2abcbf-a780-47bd-8a4d-d092679e550f None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:52.696743 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2abcbf-a780-47bd-8a4d-d092679e550f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:52.721306 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-5e2abcbf-a780-47bd-8a4d-d092679e550f None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:52.723999 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-5e2abcbf-a780-47bd-8a4d-d092679e550f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:52.764370 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1083d0a-d930-4fa9-a755-332fdb10c1ac None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:52.799906 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a8c33-af98-4b34-8fe1-789ceb14f13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:52.801016 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a8c33-af98-4b34-8fe1-789ceb14f13c None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:52.801426 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a8c33-af98-4b34-8fe1-789ceb14f13c None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:52.801819 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a8c33-af98-4b34-8fe1-789ceb14f13c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:52.823167 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a8c33-af98-4b34-8fe1-789ceb14f13c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:40:52.831971 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-e31a8c33-af98-4b34-8fe1-789ceb14f13c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:40:52.831971 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:40:52.831971 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:40:52.831971 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:40:52.831971 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:40:52.831971 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:40:52.831971 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:40:52.831971 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:40:52.831971 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:40:52.831971 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:40:52.831971 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:40:52.831971 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:40:52.831971 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:40:52.831971 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:40:52.831971 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:40:52.831971 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:40:52.832868 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:40:52.832868 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:40:52.832868 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:40:52.832868 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:40:52.832868 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:40:52.832868 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:40:52.832868 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:40:52.832868 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:40:52.832868 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:40:52.832868 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:40:52.832868 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:40:52.832868 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:40:52.832868 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:40:52.832868 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:40:52.832868 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:40:52.832868 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:40:52.833766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:40:52.833766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:40:52.833766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:40:52.833766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:40:52.833766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:40:52.833766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:40:52.833766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:40:52.833766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:40:52.833766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:40:52.833766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:40:52.833766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:40:52.833766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:40:52.836126 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 112/238] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Apr 30 20:40:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:40:52.841650 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a8c33-af98-4b34-8fe1-789ceb14f13c None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:52.874607 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 127/239] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:40:52.900505 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2abcbf-a780-47bd-8a4d-d092679e550f None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:52.948733 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a8c33-af98-4b34-8fe1-789ceb14f13c None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:52.996470 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64ced8-d086-4878-80bb-1dd136857138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:52.996470 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64ced8-d086-4878-80bb-1dd136857138 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:52.996470 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64ced8-d086-4878-80bb-1dd136857138 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:52.996470 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64ced8-d086-4878-80bb-1dd136857138 None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:52.996853 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64ced8-d086-4878-80bb-1dd136857138 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:52.996853 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64ced8-d086-4878-80bb-1dd136857138 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:52.996853 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64ced8-d086-4878-80bb-1dd136857138 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:53.005676 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 113/240] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:40:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:40:53.013274 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64ced8-d086-4878-80bb-1dd136857138 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:53.065232 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2abcbf-a780-47bd-8a4d-d092679e550f None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:53.101525 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf221e1-083b-4a84-a9e1-83c840df75c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:53.102758 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf221e1-083b-4a84-a9e1-83c840df75c6 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:53.103237 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf221e1-083b-4a84-a9e1-83c840df75c6 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:53.103750 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf221e1-083b-4a84-a9e1-83c840df75c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:53.114886 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf221e1-083b-4a84-a9e1-83c840df75c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:40:53.123019 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-3cf221e1-083b-4a84-a9e1-83c840df75c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:40:53.123019 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:40:53.123019 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:40:53.123019 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:40:53.123019 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:40:53.123019 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:40:53.123019 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:40:53.123019 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:40:53.123019 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:40:53.123019 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:40:53.123019 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:40:53.123019 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:40:53.123019 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:40:53.123019 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:40:53.123019 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:40:53.123019 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:40:53.123904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:40:53.123904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:40:53.123904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:40:53.123904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:40:53.123904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:40:53.123904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:40:53.123904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:40:53.123904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:40:53.123904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:40:53.123904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:40:53.123904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:40:53.123904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:40:53.123904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:40:53.123904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:40:53.123904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:40:53.123904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:40:53.124717 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:40:53.124717 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:40:53.124717 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:40:53.124717 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:40:53.124717 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:40:53.124717 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:40:53.124717 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:40:53.124717 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:40:53.124717 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:40:53.124717 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:40:53.124717 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:40:53.124717 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:40:53.128101 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 128/241] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Apr 30 20:40:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:40:53.135346 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf221e1-083b-4a84-a9e1-83c840df75c6 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:53.193912 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64ced8-d086-4878-80bb-1dd136857138 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:53.227990 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c0b30-6107-42fa-8495-300da8175d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:53.228869 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c0b30-6107-42fa-8495-300da8175d67 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:53.229184 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c0b30-6107-42fa-8495-300da8175d67 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:53.229462 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c0b30-6107-42fa-8495-300da8175d67 None admin] PATH_INFO: `/v3/users/26b72eaac8cb4288b713347765f9fdab` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:53.230657 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c0b30-6107-42fa-8495-300da8175d67 None admin] RBAC: Authorizing `identity:get_user(user_id=26b72eaac8cb4288b713347765f9fdab)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:53.232113 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c0b30-6107-42fa-8495-300da8175d67 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:53.233946 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 114/242] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Apr 30 20:40:53 2022] GET /identity/v3/users/26b72eaac8cb4288b713347765f9fdab => generated 283 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:53.234942 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c0ac8-f782-4705-a712-b40f7f855076 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:53.235226 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c0ac8-f782-4705-a712-b40f7f855076 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:53.235500 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c0ac8-f782-4705-a712-b40f7f855076 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:53.237534 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 115/243] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:53.238606 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf436b-59e7-480c-8279-2ccb4fffc2ba None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:53.238898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf436b-59e7-480c-8279-2ccb4fffc2ba None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:53.241673 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf436b-59e7-480c-8279-2ccb4fffc2ba None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:53.243677 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 116/244] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:53.244448 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf436b-59e7-480c-8279-2ccb4fffc2ba None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:53.248126 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf221e1-083b-4a84-a9e1-83c840df75c6 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:53.279714 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a368a9f-cc59-408b-9b06-9e4b5bdc8bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:53.280378 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a368a9f-cc59-408b-9b06-9e4b5bdc8bcd None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:53.280658 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a368a9f-cc59-408b-9b06-9e4b5bdc8bcd None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:53.280956 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a368a9f-cc59-408b-9b06-9e4b5bdc8bcd None admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:53.281694 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a368a9f-cc59-408b-9b06-9e4b5bdc8bcd None admin] RBAC: Adding query filter params (name=admin) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:53.281998 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a368a9f-cc59-408b-9b06-9e4b5bdc8bcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:53.283928 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a368a9f-cc59-408b-9b06-9e4b5bdc8bcd None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:53.292056 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 129/245] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:40:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:53.292056 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dfa6f-d667-47be-8318-1e83b6fbe2ce None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:53.292056 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dfa6f-d667-47be-8318-1e83b6fbe2ce None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:53.292056 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dfa6f-d667-47be-8318-1e83b6fbe2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:53.310928 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-c23dfa6f-d667-47be-8318-1e83b6fbe2ce None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:53.312107 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-c23dfa6f-d667-47be-8318-1e83b6fbe2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:53.349522 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf436b-59e7-480c-8279-2ccb4fffc2ba None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:53.378027 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 130/246] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:40:53.384012 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da213a-192d-49df-9ce9-84c0bfc3f4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:53.384663 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da213a-192d-49df-9ce9-84c0bfc3f4a0 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:53.384964 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da213a-192d-49df-9ce9-84c0bfc3f4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:53.385242 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da213a-192d-49df-9ce9-84c0bfc3f4a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:53.386854 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b9e9b-435a-41d3-9380-aa3673c193db None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:53.387343 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b9e9b-435a-41d3-9380-aa3673c193db None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:53.388002 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b9e9b-435a-41d3-9380-aa3673c193db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:53.410282 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-826b9e9b-435a-41d3-9380-aa3673c193db None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:53.411448 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-826b9e9b-435a-41d3-9380-aa3673c193db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:53.456019 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da213a-192d-49df-9ce9-84c0bfc3f4a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:53.457535 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da213a-192d-49df-9ce9-84c0bfc3f4a0 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:53.488933 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 131/247] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:40:53.488933 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b9e9b-435a-41d3-9380-aa3673c193db None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:53.569059 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 117/248] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:40:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:40:53.569059 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da213a-192d-49df-9ce9-84c0bfc3f4a0 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:53.592533 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b9e9b-435a-41d3-9380-aa3673c193db None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:53.629188 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b274e-94eb-4602-8b08-70efa4291052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:53.630055 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b274e-94eb-4602-8b08-70efa4291052 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:53.630353 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b274e-94eb-4602-8b08-70efa4291052 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:53.630626 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b274e-94eb-4602-8b08-70efa4291052 None admin] PATH_INFO: `/v3/users/26b72eaac8cb4288b713347765f9fdab` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:53.631807 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b274e-94eb-4602-8b08-70efa4291052 None admin] RBAC: Authorizing `identity:get_user(user_id=26b72eaac8cb4288b713347765f9fdab)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:53.633281 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b274e-94eb-4602-8b08-70efa4291052 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:53.635108 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 132/249] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Apr 30 20:40:53 2022] GET /identity/v3/users/26b72eaac8cb4288b713347765f9fdab => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:53.635644 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b274e-94eb-4602-8b08-70efa4291052 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:53.667214 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da213a-192d-49df-9ce9-84c0bfc3f4a0 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:53.698346 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3c56f-1325-4c7c-a132-b002fc05843c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:53.699130 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3c56f-1325-4c7c-a132-b002fc05843c None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:53.699406 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3c56f-1325-4c7c-a132-b002fc05843c None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:53.699674 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3c56f-1325-4c7c-a132-b002fc05843c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:53.710046 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3c56f-1325-4c7c-a132-b002fc05843c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:40:53.717668 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-8bd3c56f-1325-4c7c-a132-b002fc05843c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 30 20:40:53.717668 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:40:53.717668 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:40:53.717668 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:40:53.717668 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:40:53.717668 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:40:53.717668 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:40:53.717668 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:40:53.717668 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:40:53.717668 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:40:53.717668 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:40:53.717668 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:40:53.717668 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:40:53.717668 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:40:53.717668 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:40:53.717668 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:40:53.718665 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:40:53.718665 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:40:53.718665 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:40:53.718665 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:40:53.718665 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:40:53.718665 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:40:53.718665 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:40:53.718665 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:40:53.718665 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:40:53.718665 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:40:53.718665 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:40:53.718665 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:40:53.718665 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:40:53.718665 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:40:53.718665 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:40:53.718665 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:40:53.719470 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:40:53.719470 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:40:53.719470 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:40:53.719470 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:40:53.719470 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:40:53.719470 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:40:53.719470 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:40:53.719470 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:40:53.719470 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:40:53.719470 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:40:53.719470 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Apr 30 20:40:53.719470 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:40:53.719470 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 118/250] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:40:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:40:53.720126 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3c56f-1325-4c7c-a132-b002fc05843c None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:53.734669 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b274e-94eb-4602-8b08-70efa4291052 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:53.766721 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44879744-bdee-4ebe-ae48-c4b1ee578758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:53.768040 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44879744-bdee-4ebe-ae48-c4b1ee578758 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:53.768323 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44879744-bdee-4ebe-ae48-c4b1ee578758 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:53.768740 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44879744-bdee-4ebe-ae48-c4b1ee578758 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:53.769938 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44879744-bdee-4ebe-ae48-c4b1ee578758 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:53.771489 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44879744-bdee-4ebe-ae48-c4b1ee578758 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:53.773133 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 133/251] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:40:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:53.773886 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44879744-bdee-4ebe-ae48-c4b1ee578758 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:53.817443 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3c56f-1325-4c7c-a132-b002fc05843c None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:53.851622 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374009a-d4e3-4660-ac5d-f775bee6f826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:53.852614 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374009a-d4e3-4660-ac5d-f775bee6f826 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:53.852966 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374009a-d4e3-4660-ac5d-f775bee6f826 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:53.853307 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374009a-d4e3-4660-ac5d-f775bee6f826 None admin] PATH_INFO: `/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:53.854608 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374009a-d4e3-4660-ac5d-f775bee6f826 None admin] RBAC: Authorizing `identity:get_project(project_id=5141353bfd044a1ba7fb8ba70efe9a73)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:53.856367 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374009a-d4e3-4660-ac5d-f775bee6f826 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:53.858228 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 119/252] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:40:53 2022] GET /identity/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:53.859586 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47437d8-7766-4cfa-8eae-b8c854dbf999 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:53.859897 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47437d8-7766-4cfa-8eae-b8c854dbf999 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:53.860209 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47437d8-7766-4cfa-8eae-b8c854dbf999 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:53.862302 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 120/253] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:53.863328 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47437d8-7766-4cfa-8eae-b8c854dbf999 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:53.870792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44879744-bdee-4ebe-ae48-c4b1ee578758 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:53.903430 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf74b0c-996a-49ad-9f2b-01192476652f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:53.904105 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf74b0c-996a-49ad-9f2b-01192476652f None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:53.904384 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf74b0c-996a-49ad-9f2b-01192476652f None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:53.904657 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf74b0c-996a-49ad-9f2b-01192476652f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:53.961661 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47437d8-7766-4cfa-8eae-b8c854dbf999 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:53.969151 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf74b0c-996a-49ad-9f2b-01192476652f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:53.971112 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf74b0c-996a-49ad-9f2b-01192476652f None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:53.994048 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00342074-9fb2-4674-9c60-ce4c1c5e9440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:53.994709 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00342074-9fb2-4674-9c60-ce4c1c5e9440 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:53.994984 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00342074-9fb2-4674-9c60-ce4c1c5e9440 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:53.995257 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00342074-9fb2-4674-9c60-ce4c1c5e9440 None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:53.995980 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00342074-9fb2-4674-9c60-ce4c1c5e9440 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:53.996288 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00342074-9fb2-4674-9c60-ce4c1c5e9440 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:53.997683 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00342074-9fb2-4674-9c60-ce4c1c5e9440 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:54.005632 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 121/254] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Apr 30 20:40:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:54.006459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00342074-9fb2-4674-9c60-ce4c1c5e9440 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:54.066693 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 134/255] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:40:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:40:54.070794 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf74b0c-996a-49ad-9f2b-01192476652f None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:54.103357 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00342074-9fb2-4674-9c60-ce4c1c5e9440 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:54.135198 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11095434-8936-456c-9a43-a10831b58503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:54.135857 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11095434-8936-456c-9a43-a10831b58503 None admin] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:54.136137 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11095434-8936-456c-9a43-a10831b58503 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:54.136411 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11095434-8936-456c-9a43-a10831b58503 None admin] PATH_INFO: `/v3/users` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:54.137136 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11095434-8936-456c-9a43-a10831b58503 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:54.138571 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11095434-8936-456c-9a43-a10831b58503 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:54.161274 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf74b0c-996a-49ad-9f2b-01192476652f None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:54.193646 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22df72-53fd-4848-b123-479476260442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:54.194282 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22df72-53fd-4848-b123-479476260442 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:54.194559 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22df72-53fd-4848-b123-479476260442 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:54.194830 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22df72-53fd-4848-b123-479476260442 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:54.195634 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22df72-53fd-4848-b123-479476260442 None admin] RBAC: Adding query filter params (role.id=f76bb9b1c47a4fbfa232de16b0b4a0d5, scope.project.id=5141353bfd044a1ba7fb8ba70efe9a73, user.id=26b72eaac8cb4288b713347765f9fdab) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:54.195940 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22df72-53fd-4848-b123-479476260442 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:54.197407 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22df72-53fd-4848-b123-479476260442 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:54.202909 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 135/256] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Apr 30 20:40:54 2022] GET /identity/v3/role_assignments?user.id=26b72eaac8cb4288b713347765f9fdab&scope.project.id=5141353bfd044a1ba7fb8ba70efe9a73&role.id=f76bb9b1c47a4fbfa232de16b0b4a0d5 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:54.204224 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df083910-7a7f-49b6-b1ee-948216e599ba None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:54.204510 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df083910-7a7f-49b6-b1ee-948216e599ba None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:54.204779 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df083910-7a7f-49b6-b1ee-948216e599ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:54.222067 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-df083910-7a7f-49b6-b1ee-948216e599ba None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:54.223285 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-df083910-7a7f-49b6-b1ee-948216e599ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:54.250354 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 122/257] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Apr 30 20:40:54 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:40:54.251198 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11095434-8936-456c-9a43-a10831b58503 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:54.340342 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 136/258] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:40:54.340342 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df083910-7a7f-49b6-b1ee-948216e599ba None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:54.383092 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11095434-8936-456c-9a43-a10831b58503 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:54.441546 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e7f60-a2bf-44f9-b86a-2075e3403857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:54.442886 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e7f60-a2bf-44f9-b86a-2075e3403857 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:54.442886 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e7f60-a2bf-44f9-b86a-2075e3403857 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:54.443053 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e7f60-a2bf-44f9-b86a-2075e3403857 None admin] PATH_INFO: `/v3/users/e3f57a8e4414452cbed58ec3a1428728` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:54.463308 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e7f60-a2bf-44f9-b86a-2075e3403857 None admin] RBAC: Authorizing `identity:get_user(user_id=e3f57a8e4414452cbed58ec3a1428728)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:54.464315 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e7f60-a2bf-44f9-b86a-2075e3403857 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:54.466300 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 123/259] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Apr 30 20:40:54 2022] GET /identity/v3/users/e3f57a8e4414452cbed58ec3a1428728 => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:54.466906 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e7f60-a2bf-44f9-b86a-2075e3403857 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:54.486285 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df083910-7a7f-49b6-b1ee-948216e599ba None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:54.524623 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f7705-dacc-4821-b84c-14592689829e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:54.525530 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f7705-dacc-4821-b84c-14592689829e None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:54.525858 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f7705-dacc-4821-b84c-14592689829e None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:54.526130 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f7705-dacc-4821-b84c-14592689829e None admin] PATH_INFO: `/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:54.527307 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f7705-dacc-4821-b84c-14592689829e None admin] RBAC: Authorizing `identity:get_project(project_id=5141353bfd044a1ba7fb8ba70efe9a73)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:54.532813 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f7705-dacc-4821-b84c-14592689829e None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:54.532813 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 137/260] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:40:54 2022] GET /identity/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:54.532813 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f7705-dacc-4821-b84c-14592689829e None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:54.572248 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e7f60-a2bf-44f9-b86a-2075e3403857 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:54.609868 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218dd82c-78f3-4de4-a787-0ec1b081a155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:54.610675 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218dd82c-78f3-4de4-a787-0ec1b081a155 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:54.610958 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218dd82c-78f3-4de4-a787-0ec1b081a155 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:54.611265 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218dd82c-78f3-4de4-a787-0ec1b081a155 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:54.623313 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218dd82c-78f3-4de4-a787-0ec1b081a155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:40:54.632416 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-218dd82c-78f3-4de4-a787-0ec1b081a155 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:40:54.632416 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:40:54.632416 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:40:54.632416 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:40:54.632416 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:40:54.632416 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:40:54.632416 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:40:54.632416 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:40:54.632416 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:40:54.632416 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:40:54.632416 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:40:54.632416 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:40:54.632416 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:40:54.632416 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:40:54.632416 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:40:54.632416 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:40:54.633445 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:40:54.633445 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:40:54.633445 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:40:54.633445 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:40:54.633445 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:40:54.633445 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:40:54.633445 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:40:54.633445 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:40:54.633445 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:40:54.633445 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:40:54.633445 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:40:54.633445 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:40:54.633445 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:40:54.633445 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:40:54.633445 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:40:54.633445 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:40:54.634407 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:40:54.634407 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:40:54.634407 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:40:54.634407 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:40:54.634407 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:40:54.634407 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:40:54.634407 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:40:54.634407 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:40:54.634407 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:40:54.634407 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:40:54.634407 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:40:54.634407 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:40:54.634407 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 124/261] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:40:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:40:54.634407 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218dd82c-78f3-4de4-a787-0ec1b081a155 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:54.661263 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f7705-dacc-4821-b84c-14592689829e None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:54.708460 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8f902-dfe8-46e2-b34d-946069a5355d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:54.709149 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8f902-dfe8-46e2-b34d-946069a5355d None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:54.709591 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8f902-dfe8-46e2-b34d-946069a5355d None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:54.709864 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8f902-dfe8-46e2-b34d-946069a5355d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:54.741182 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218dd82c-78f3-4de4-a787-0ec1b081a155 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:54.776449 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2886624-9405-486b-a53b-fcfc917637dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:54.777136 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2886624-9405-486b-a53b-fcfc917637dc None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:54.777418 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2886624-9405-486b-a53b-fcfc917637dc None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:54.777751 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2886624-9405-486b-a53b-fcfc917637dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:54.778578 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2886624-9405-486b-a53b-fcfc917637dc None admin] RBAC: Adding query filter params (role.id=31b3f11a82cd4cd2823e88aa0e931323, scope.project.id=5141353bfd044a1ba7fb8ba70efe9a73, user.id=26b72eaac8cb4288b713347765f9fdab) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:54.779026 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2886624-9405-486b-a53b-fcfc917637dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:54.780498 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2886624-9405-486b-a53b-fcfc917637dc None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:54.787632 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 125/262] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Apr 30 20:40:54 2022] GET /identity/v3/role_assignments?user.id=26b72eaac8cb4288b713347765f9fdab&scope.project.id=5141353bfd044a1ba7fb8ba70efe9a73&role.id=31b3f11a82cd4cd2823e88aa0e931323 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:54.788466 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2886624-9405-486b-a53b-fcfc917637dc None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:54.794933 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf8f902-dfe8-46e2-b34d-946069a5355d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:54.796459 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf8f902-dfe8-46e2-b34d-946069a5355d None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:54.908875 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2886624-9405-486b-a53b-fcfc917637dc None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:54.930145 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 138/263] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:40:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:40:54.937968 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8f902-dfe8-46e2-b34d-946069a5355d None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:54.952936 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632f3eb-8f20-47dd-b2dc-15bffc95844f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:54.952936 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632f3eb-8f20-47dd-b2dc-15bffc95844f None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:54.952936 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632f3eb-8f20-47dd-b2dc-15bffc95844f None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:54.952936 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632f3eb-8f20-47dd-b2dc-15bffc95844f None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:54.953343 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632f3eb-8f20-47dd-b2dc-15bffc95844f None admin] RBAC: Adding query filter params (name=member) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:54.953343 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632f3eb-8f20-47dd-b2dc-15bffc95844f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:54.953343 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632f3eb-8f20-47dd-b2dc-15bffc95844f None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:54.964942 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 126/264] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Apr 30 20:40:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:54.967013 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632f3eb-8f20-47dd-b2dc-15bffc95844f None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:55.119260 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8f902-dfe8-46e2-b34d-946069a5355d None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:55.130391 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632f3eb-8f20-47dd-b2dc-15bffc95844f None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:55.159160 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbcbc0a-cce8-4eb2-b396-30439b7fe34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:55.159955 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcbc0a-cce8-4eb2-b396-30439b7fe34a None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:55.160227 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcbc0a-cce8-4eb2-b396-30439b7fe34a None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:55.160496 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcbc0a-cce8-4eb2-b396-30439b7fe34a None admin] PATH_INFO: `/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:55.161751 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbcbc0a-cce8-4eb2-b396-30439b7fe34a None admin] RBAC: Authorizing `identity:get_project(project_id=5141353bfd044a1ba7fb8ba70efe9a73)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:55.163209 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbcbc0a-cce8-4eb2-b396-30439b7fe34a None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:55.165308 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 139/265] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:40:54 2022] GET /identity/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:55.170769 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbcbc0a-cce8-4eb2-b396-30439b7fe34a None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:55.176856 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60684c-bd1a-4c89-ae69-697301517f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:55.177780 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60684c-bd1a-4c89-ae69-697301517f5c None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:55.178058 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60684c-bd1a-4c89-ae69-697301517f5c None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:55.178327 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60684c-bd1a-4c89-ae69-697301517f5c None admin] PATH_INFO: `/v3/users/69d105124f354de09d9e704d45c92f64` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:55.181702 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60684c-bd1a-4c89-ae69-697301517f5c None admin] RBAC: Authorizing `identity:get_user(user_id=69d105124f354de09d9e704d45c92f64)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:55.183287 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60684c-bd1a-4c89-ae69-697301517f5c None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:55.185116 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 127/266] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Apr 30 20:40:54 2022] GET /identity/v3/users/69d105124f354de09d9e704d45c92f64 => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:55.190966 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60684c-bd1a-4c89-ae69-697301517f5c None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:55.300087 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbcbc0a-cce8-4eb2-b396-30439b7fe34a None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:55.310863 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60684c-bd1a-4c89-ae69-697301517f5c None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:55.335230 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e97215-e36c-40b6-9266-2b1579dc21b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:55.336267 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e97215-e36c-40b6-9266-2b1579dc21b8 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:55.336751 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e97215-e36c-40b6-9266-2b1579dc21b8 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:55.337254 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e97215-e36c-40b6-9266-2b1579dc21b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:55.338270 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e97215-e36c-40b6-9266-2b1579dc21b8 None admin] RBAC: Adding query filter params (role.id=ca508df0c9124b8d97536818daba3aee, scope.project.id=5141353bfd044a1ba7fb8ba70efe9a73, user.id=e3f57a8e4414452cbed58ec3a1428728) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:55.338779 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e97215-e36c-40b6-9266-2b1579dc21b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:55.340460 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e97215-e36c-40b6-9266-2b1579dc21b8 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:55.353036 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 140/267] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Apr 30 20:40:55 2022] GET /identity/v3/role_assignments?user.id=e3f57a8e4414452cbed58ec3a1428728&scope.project.id=5141353bfd044a1ba7fb8ba70efe9a73&role.id=ca508df0c9124b8d97536818daba3aee => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:55.353867 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4adf8cf-e746-4aa6-b6bf-fa0aafaacfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:55.354766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adf8cf-e746-4aa6-b6bf-fa0aafaacfa1 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:55.355044 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adf8cf-e746-4aa6-b6bf-fa0aafaacfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:55.355314 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adf8cf-e746-4aa6-b6bf-fa0aafaacfa1 None admin] PATH_INFO: `/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:55.356603 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4adf8cf-e746-4aa6-b6bf-fa0aafaacfa1 None admin] RBAC: Authorizing `identity:get_project(project_id=5141353bfd044a1ba7fb8ba70efe9a73)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:55.358135 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4adf8cf-e746-4aa6-b6bf-fa0aafaacfa1 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:55.360067 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 128/268] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:40:55 2022] GET /identity/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:40:55.366592 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e97215-e36c-40b6-9266-2b1579dc21b8 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:55.478901 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e97215-e36c-40b6-9266-2b1579dc21b8 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:55.519380 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0f5fc-9a1d-4a6e-9247-6155ab934fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:55.520293 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0f5fc-9a1d-4a6e-9247-6155ab934fb3 None admin] REQUEST_METHOD: `PUT` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:55.520572 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0f5fc-9a1d-4a6e-9247-6155ab934fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:55.520838 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0f5fc-9a1d-4a6e-9247-6155ab934fb3 None admin] PATH_INFO: `/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73/users/69d105124f354de09d9e704d45c92f64/roles/375abc9f701c408ea332eaf2d8a2e086` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:55.522915 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff0f5fc-9a1d-4a6e-9247-6155ab934fb3 None admin] RBAC: Authorizing `identity:create_grant(project_id=5141353bfd044a1ba7fb8ba70efe9a73, user_id=69d105124f354de09d9e704d45c92f64, role_id=375abc9f701c408ea332eaf2d8a2e086)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:55.524617 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff0f5fc-9a1d-4a6e-9247-6155ab934fb3 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:55.629284 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 141/269] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Apr 30 20:40:55 2022] PUT /identity/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73/users/69d105124f354de09d9e704d45c92f64/roles/375abc9f701c408ea332eaf2d8a2e086 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:40:56.797634 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87d01f-c778-4131-969e-eef9b45d911f None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:56.798278 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87d01f-c778-4131-969e-eef9b45d911f None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:56.798278 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87d01f-c778-4131-969e-eef9b45d911f None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:56.800687 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 129/270] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:56.806824 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c5886-9e78-416f-b247-7aa540bcf18c None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:56.807813 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c5886-9e78-416f-b247-7aa540bcf18c None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:56.808311 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c5886-9e78-416f-b247-7aa540bcf18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:56.833105 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-8a9c5886-9e78-416f-b247-7aa540bcf18c None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:56.834719 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-8a9c5886-9e78-416f-b247-7aa540bcf18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:56.903871 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 142/271] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:40:56.928853 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f87d01f-c778-4131-969e-eef9b45d911f None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:56.991644 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933c2e2-0ba0-4d13-99dd-db69b57cea10 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:56.992274 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933c2e2-0ba0-4d13-99dd-db69b57cea10 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:56.992759 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933c2e2-0ba0-4d13-99dd-db69b57cea10 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:56.994586 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 143/272] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:57.003327 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8edc76-ecf4-4212-8e46-ea3265ca817a None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:57.003609 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8edc76-ecf4-4212-8e46-ea3265ca817a None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:57.003883 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8edc76-ecf4-4212-8e46-ea3265ca817a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:57.021402 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-ab8edc76-ecf4-4212-8e46-ea3265ca817a None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:57.022570 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-ab8edc76-ecf4-4212-8e46-ea3265ca817a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:57.046966 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f87d01f-c778-4131-969e-eef9b45d911f None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:57.088415 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 144/273] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:40:57.089503 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fba37c-9d36-41d9-8fea-89c9c120f0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:57.090930 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fba37c-9d36-41d9-8fea-89c9c120f0fb None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:57.091540 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fba37c-9d36-41d9-8fea-89c9c120f0fb None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:57.092126 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fba37c-9d36-41d9-8fea-89c9c120f0fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:57.104088 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fba37c-9d36-41d9-8fea-89c9c120f0fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:40:57.112771 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-53fba37c-9d36-41d9-8fea-89c9c120f0fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:40:57.112771 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:40:57.112771 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:40:57.112771 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:40:57.112771 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:40:57.112771 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:40:57.112771 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:40:57.112771 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:40:57.112771 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:40:57.112771 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:40:57.112771 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:40:57.112771 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:40:57.112771 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:40:57.112771 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:40:57.112771 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:40:57.112771 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:40:57.113923 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:40:57.113923 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:40:57.113923 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:40:57.113923 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:40:57.113923 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:40:57.113923 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:40:57.113923 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:40:57.113923 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:40:57.113923 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:40:57.113923 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:40:57.113923 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:40:57.113923 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:40:57.113923 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:40:57.113923 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:40:57.113923 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:40:57.113923 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:40:57.114908 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:40:57.114908 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:40:57.114908 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:40:57.114908 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:40:57.114908 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:40:57.114908 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:40:57.114908 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:40:57.114908 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:40:57.114908 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:40:57.114908 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:40:57.114908 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:40:57.114908 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:40:57.117024 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 130/274] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:40:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:40:57.120968 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8edc76-ecf4-4212-8e46-ea3265ca817a None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:57.122956 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fba37c-9d36-41d9-8fea-89c9c120f0fb None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:57.224658 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8edc76-ecf4-4212-8e46-ea3265ca817a None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:57.226006 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fba37c-9d36-41d9-8fea-89c9c120f0fb None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:57.260553 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a011608-522a-4af7-85d6-0151f54f5100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:57.260937 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76a863-7034-4cdd-a949-aa427c7d3076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:57.261747 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76a863-7034-4cdd-a949-aa427c7d3076 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:57.261982 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a011608-522a-4af7-85d6-0151f54f5100 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:57.262211 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76a863-7034-4cdd-a949-aa427c7d3076 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:57.262562 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a011608-522a-4af7-85d6-0151f54f5100 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:57.262668 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76a863-7034-4cdd-a949-aa427c7d3076 None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:57.263064 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a011608-522a-4af7-85d6-0151f54f5100 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:57.263660 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76a863-7034-4cdd-a949-aa427c7d3076 None admin] RBAC: Adding query filter params (name=member) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:57.264042 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76a863-7034-4cdd-a949-aa427c7d3076 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:57.264853 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a011608-522a-4af7-85d6-0151f54f5100 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:57.265670 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76a863-7034-4cdd-a949-aa427c7d3076 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:57.266515 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a011608-522a-4af7-85d6-0151f54f5100 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:57.268437 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 145/275] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:40:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:57.274062 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a011608-522a-4af7-85d6-0151f54f5100 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:57.283782 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 131/276] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Apr 30 20:40:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:40:57.283782 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76a863-7034-4cdd-a949-aa427c7d3076 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:57.376479 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a011608-522a-4af7-85d6-0151f54f5100 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:57.385287 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76a863-7034-4cdd-a949-aa427c7d3076 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:57.415687 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f3988-60f5-4fc9-9a61-070177c7ace6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:57.416717 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f3988-60f5-4fc9-9a61-070177c7ace6 None admin] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:57.416960 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f3988-60f5-4fc9-9a61-070177c7ace6 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:57.417376 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f3988-60f5-4fc9-9a61-070177c7ace6 None admin] PATH_INFO: `/v3/users` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:57.418083 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f3988-60f5-4fc9-9a61-070177c7ace6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:57.419815 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f3988-60f5-4fc9-9a61-070177c7ace6 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:57.419940 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb34851-f0d1-46ff-987f-99e983cd08df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:57.420843 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb34851-f0d1-46ff-987f-99e983cd08df None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:57.421243 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb34851-f0d1-46ff-987f-99e983cd08df None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:57.421599 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb34851-f0d1-46ff-987f-99e983cd08df None admin] PATH_INFO: `/v3/users/3832f7db12ac4a4fad1c2a7616b590f6` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:57.436507 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb34851-f0d1-46ff-987f-99e983cd08df None admin] RBAC: Authorizing `identity:get_user(user_id=3832f7db12ac4a4fad1c2a7616b590f6)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:57.438173 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb34851-f0d1-46ff-987f-99e983cd08df None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:57.440191 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 132/277] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Apr 30 20:40:57 2022] GET /identity/v3/users/3832f7db12ac4a4fad1c2a7616b590f6 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:40:57.448132 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb34851-f0d1-46ff-987f-99e983cd08df None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:57.490338 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 146/278] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Apr 30 20:40:57 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:40:57.560632 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb34851-f0d1-46ff-987f-99e983cd08df None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:57.599603 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9893bc-ff8a-4206-8cc5-79de8c773e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:57.600278 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9893bc-ff8a-4206-8cc5-79de8c773e7c None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:57.600811 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9893bc-ff8a-4206-8cc5-79de8c773e7c None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:57.601126 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9893bc-ff8a-4206-8cc5-79de8c773e7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:57.601963 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9893bc-ff8a-4206-8cc5-79de8c773e7c None admin] RBAC: Adding query filter params (role.id=375abc9f701c408ea332eaf2d8a2e086, user.id=3832f7db12ac4a4fad1c2a7616b590f6, scope.system=all) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:57.602277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9893bc-ff8a-4206-8cc5-79de8c773e7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:57.603784 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9893bc-ff8a-4206-8cc5-79de8c773e7c None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:57.610039 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 133/279] 10.222.0.26 () {56 vars in 1308 bytes} [Sat Apr 30 20:40:57 2022] GET /identity/v3/role_assignments?user.id=3832f7db12ac4a4fad1c2a7616b590f6&scope.system=all&role.id=375abc9f701c408ea332eaf2d8a2e086 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:57.725770 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c911b-6ae9-49ee-afda-91c006cb85a9 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:57.726144 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c911b-6ae9-49ee-afda-91c006cb85a9 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:57.726256 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c911b-6ae9-49ee-afda-91c006cb85a9 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:57.727949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 147/280] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:57.733765 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f296691-63a0-4e46-a7c0-1dabad06ca01 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:57.734069 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f296691-63a0-4e46-a7c0-1dabad06ca01 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:57.734327 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f296691-63a0-4e46-a7c0-1dabad06ca01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:57.754574 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-3f296691-63a0-4e46-a7c0-1dabad06ca01 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:57.755805 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-3f296691-63a0-4e46-a7c0-1dabad06ca01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:57.835272 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 134/281] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:40:57.862401 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c911b-6ae9-49ee-afda-91c006cb85a9 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:57.982192 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c911b-6ae9-49ee-afda-91c006cb85a9 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:58.005242 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180939f-8da6-414d-b4d9-76b009274316 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:58.005593 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180939f-8da6-414d-b4d9-76b009274316 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:58.005793 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180939f-8da6-414d-b4d9-76b009274316 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:58.007430 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 135/282] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:40:58.014211 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51312d60-56be-4eef-a1a4-696bf57079d6 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:58.014502 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51312d60-56be-4eef-a1a4-696bf57079d6 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:58.014783 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51312d60-56be-4eef-a1a4-696bf57079d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:58.038645 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-51312d60-56be-4eef-a1a4-696bf57079d6 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:40:58.039824 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-51312d60-56be-4eef-a1a4-696bf57079d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:40:58.042937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc8915-c694-4a01-8176-65e58f63a051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:58.043744 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc8915-c694-4a01-8176-65e58f63a051 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:58.044026 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc8915-c694-4a01-8176-65e58f63a051 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:58.044297 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc8915-c694-4a01-8176-65e58f63a051 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:58.063110 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc8915-c694-4a01-8176-65e58f63a051 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:40:58.071141 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-fbbc8915-c694-4a01-8176-65e58f63a051 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 30 20:40:58.071141 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:40:58.071141 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:40:58.071141 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:40:58.071141 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:40:58.071141 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:40:58.071141 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:40:58.071141 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:40:58.071141 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:40:58.071141 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:40:58.071141 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:40:58.071141 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:40:58.071141 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:40:58.071141 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:40:58.071141 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:40:58.071141 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:40:58.072048 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:40:58.072048 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:40:58.072048 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:40:58.072048 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:40:58.072048 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:40:58.072048 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:40:58.072048 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:40:58.072048 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:40:58.072048 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:40:58.072048 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:40:58.072048 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:40:58.072048 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:40:58.072048 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:40:58.072048 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:40:58.072048 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:40:58.072048 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:40:58.073494 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:40:58.073494 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:40:58.073494 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:40:58.073494 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:40:58.073494 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:40:58.073494 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:40:58.073494 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:40:58.073494 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:40:58.073494 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:40:58.073494 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:40:58.073494 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Apr 30 20:40:58.073494 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:40:58.073494 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 148/283] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:40:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:40:58.081427 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc8915-c694-4a01-8176-65e58f63a051 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:58.195094 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 136/284] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:40:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:40:58.235014 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc8915-c694-4a01-8176-65e58f63a051 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:58.243234 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51312d60-56be-4eef-a1a4-696bf57079d6 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:58.303633 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47540265-8f1a-4003-9373-0d0b804623db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:58.304737 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47540265-8f1a-4003-9373-0d0b804623db None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:58.305250 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47540265-8f1a-4003-9373-0d0b804623db None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:58.305711 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47540265-8f1a-4003-9373-0d0b804623db None admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:58.306730 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47540265-8f1a-4003-9373-0d0b804623db None admin] RBAC: Adding query filter params (name=reader) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:58.307229 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47540265-8f1a-4003-9373-0d0b804623db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:58.308810 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47540265-8f1a-4003-9373-0d0b804623db None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:58.319384 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 149/285] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Apr 30 20:40:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:58.325922 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47540265-8f1a-4003-9373-0d0b804623db None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:58.443170 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51312d60-56be-4eef-a1a4-696bf57079d6 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:58.466142 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47540265-8f1a-4003-9373-0d0b804623db None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:58.501655 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823dd4c6-626f-43ae-9153-6aedd8d80b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:58.503211 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823dd4c6-626f-43ae-9153-6aedd8d80b8e None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:58.503503 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823dd4c6-626f-43ae-9153-6aedd8d80b8e None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:58.503759 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823dd4c6-626f-43ae-9153-6aedd8d80b8e None admin] PATH_INFO: `/v3/users/e3f57a8e4414452cbed58ec3a1428728` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:58.505057 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823dd4c6-626f-43ae-9153-6aedd8d80b8e None admin] RBAC: Authorizing `identity:get_user(user_id=e3f57a8e4414452cbed58ec3a1428728)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:58.506605 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823dd4c6-626f-43ae-9153-6aedd8d80b8e None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:58.508472 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 150/286] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Apr 30 20:40:58 2022] GET /identity/v3/users/e3f57a8e4414452cbed58ec3a1428728 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:58.509774 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f170a3e-fc1c-41e8-b363-bb326b6c46ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:58.510590 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f170a3e-fc1c-41e8-b363-bb326b6c46ed None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:58.510872 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f170a3e-fc1c-41e8-b363-bb326b6c46ed None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:58.511145 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f170a3e-fc1c-41e8-b363-bb326b6c46ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:58.513593 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823dd4c6-626f-43ae-9153-6aedd8d80b8e None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:58.533755 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f170a3e-fc1c-41e8-b363-bb326b6c46ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:40:58.542104 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-3f170a3e-fc1c-41e8-b363-bb326b6c46ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:40:58.542104 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:40:58.542104 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:40:58.542104 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:40:58.542104 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:40:58.542104 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:40:58.542104 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:40:58.542104 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:40:58.542104 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:40:58.542104 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:40:58.542104 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:40:58.542104 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:40:58.542104 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:40:58.542104 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:40:58.542104 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:40:58.542104 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:40:58.543007 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:40:58.543007 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:40:58.543007 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:40:58.543007 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:40:58.543007 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:40:58.543007 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:40:58.543007 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:40:58.543007 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:40:58.543007 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:40:58.543007 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:40:58.543007 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:40:58.543007 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:40:58.543007 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:40:58.543007 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:40:58.543007 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:40:58.543007 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:40:58.544578 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:40:58.544578 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:40:58.544578 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:40:58.544578 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:40:58.544578 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:40:58.544578 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:40:58.544578 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:40:58.544578 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:40:58.544578 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:40:58.544578 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:40:58.544578 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:40:58.544578 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:40:58.544578 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 137/287] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:40:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:40:58.551786 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f170a3e-fc1c-41e8-b363-bb326b6c46ed None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:58.630561 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823dd4c6-626f-43ae-9153-6aedd8d80b8e None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:58.686197 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66931f-47fd-4b45-85da-49f75de4be91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:58.687251 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66931f-47fd-4b45-85da-49f75de4be91 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:58.687362 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66931f-47fd-4b45-85da-49f75de4be91 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:58.687617 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66931f-47fd-4b45-85da-49f75de4be91 None admin] PATH_INFO: `/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:58.693774 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66931f-47fd-4b45-85da-49f75de4be91 None admin] RBAC: Authorizing `identity:get_project(project_id=5141353bfd044a1ba7fb8ba70efe9a73)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:58.695288 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66931f-47fd-4b45-85da-49f75de4be91 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:58.697035 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 151/288] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:40:58 2022] GET /identity/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:40:58.706596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66931f-47fd-4b45-85da-49f75de4be91 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:58.742628 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f170a3e-fc1c-41e8-b363-bb326b6c46ed None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:58.789518 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eabd12-c77d-4883-bf82-286eea35d3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:58.790648 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eabd12-c77d-4883-bf82-286eea35d3cd None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:58.791179 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eabd12-c77d-4883-bf82-286eea35d3cd None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:58.791658 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eabd12-c77d-4883-bf82-286eea35d3cd None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:58.792607 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eabd12-c77d-4883-bf82-286eea35d3cd None admin] RBAC: Adding query filter params (name=member) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:58.793869 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eabd12-c77d-4883-bf82-286eea35d3cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:58.795501 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eabd12-c77d-4883-bf82-286eea35d3cd None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:58.806184 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 138/289] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Apr 30 20:40:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:40:58.813664 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eabd12-c77d-4883-bf82-286eea35d3cd None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:58.920092 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eabd12-c77d-4883-bf82-286eea35d3cd None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:58.962943 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42bd57-9f2c-482b-a0e6-0b782628cb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:58.964249 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42bd57-9f2c-482b-a0e6-0b782628cb3e None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:58.964732 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42bd57-9f2c-482b-a0e6-0b782628cb3e None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:58.965238 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42bd57-9f2c-482b-a0e6-0b782628cb3e None admin] PATH_INFO: `/v3/users/69d105124f354de09d9e704d45c92f64` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:58.967781 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42bd57-9f2c-482b-a0e6-0b782628cb3e None admin] RBAC: Authorizing `identity:get_user(user_id=69d105124f354de09d9e704d45c92f64)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:58.970211 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42bd57-9f2c-482b-a0e6-0b782628cb3e None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:58.973121 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 139/290] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Apr 30 20:40:58 2022] GET /identity/v3/users/69d105124f354de09d9e704d45c92f64 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:58.975402 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66931f-47fd-4b45-85da-49f75de4be91 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:58.978822 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42bd57-9f2c-482b-a0e6-0b782628cb3e None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:59.058236 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e784c5-ddb7-48c6-b2dc-a35766560889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:59.059509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e784c5-ddb7-48c6-b2dc-a35766560889 None admin] REQUEST_METHOD: `PUT` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:59.060004 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e784c5-ddb7-48c6-b2dc-a35766560889 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:59.060488 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e784c5-ddb7-48c6-b2dc-a35766560889 None admin] PATH_INFO: `/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73/users/e3f57a8e4414452cbed58ec3a1428728/roles/ca508df0c9124b8d97536818daba3aee` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:59.066898 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e784c5-ddb7-48c6-b2dc-a35766560889 None admin] RBAC: Authorizing `identity:create_grant(project_id=5141353bfd044a1ba7fb8ba70efe9a73, user_id=e3f57a8e4414452cbed58ec3a1428728, role_id=ca508df0c9124b8d97536818daba3aee)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:59.068737 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e784c5-ddb7-48c6-b2dc-a35766560889 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:59.140932 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42bd57-9f2c-482b-a0e6-0b782628cb3e None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:59.170626 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 152/291] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Apr 30 20:40:58 2022] PUT /identity/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73/users/e3f57a8e4414452cbed58ec3a1428728/roles/ca508df0c9124b8d97536818daba3aee => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:40:59.200815 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8ad24-5584-4996-b308-f9756c2537d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:59.201522 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8ad24-5584-4996-b308-f9756c2537d8 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:59.203065 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8ad24-5584-4996-b308-f9756c2537d8 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:59.203065 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8ad24-5584-4996-b308-f9756c2537d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:59.293026 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8ad24-5584-4996-b308-f9756c2537d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:59.294892 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8ad24-5584-4996-b308-f9756c2537d8 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:59.402154 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 140/292] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:40:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:40:59.408982 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e784c5-ddb7-48c6-b2dc-a35766560889 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:59.547956 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e784c5-ddb7-48c6-b2dc-a35766560889 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:59.685871 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ea2f2-8594-4707-834a-de9f2281ca45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:59.686665 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ea2f2-8594-4707-834a-de9f2281ca45 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:59.686948 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ea2f2-8594-4707-834a-de9f2281ca45 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:59.687224 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ea2f2-8594-4707-834a-de9f2281ca45 None admin] PATH_INFO: `/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:59.690550 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ea2f2-8594-4707-834a-de9f2281ca45 None admin] RBAC: Authorizing `identity:get_project(project_id=5141353bfd044a1ba7fb8ba70efe9a73)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:59.692030 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ea2f2-8594-4707-834a-de9f2281ca45 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:59.694163 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 153/293] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:40:59 2022] GET /identity/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73 => generated 302 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:40:59.700145 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8ad24-5584-4996-b308-f9756c2537d8 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:40:59.836037 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8ad24-5584-4996-b308-f9756c2537d8 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:40:59.871601 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faacf60-7bcc-4f0c-90cf-13e689e0e705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:40:59.872265 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faacf60-7bcc-4f0c-90cf-13e689e0e705 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:40:59.872551 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faacf60-7bcc-4f0c-90cf-13e689e0e705 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:40:59.872828 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faacf60-7bcc-4f0c-90cf-13e689e0e705 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:40:59.873686 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faacf60-7bcc-4f0c-90cf-13e689e0e705 None admin] RBAC: Adding query filter params (role.id=375abc9f701c408ea332eaf2d8a2e086, scope.project.id=5141353bfd044a1ba7fb8ba70efe9a73, user.id=69d105124f354de09d9e704d45c92f64) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:40:59.874001 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faacf60-7bcc-4f0c-90cf-13e689e0e705 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:40:59.875463 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faacf60-7bcc-4f0c-90cf-13e689e0e705 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:40:59.882836 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 141/294] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Apr 30 20:40:59 2022] GET /identity/v3/role_assignments?user.id=69d105124f354de09d9e704d45c92f64&scope.project.id=5141353bfd044a1ba7fb8ba70efe9a73&role.id=375abc9f701c408ea332eaf2d8a2e086 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:00.247869 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3758c02-f6fb-412a-8b80-69fb08505208 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:00.248394 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3758c02-f6fb-412a-8b80-69fb08505208 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:00.248394 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3758c02-f6fb-412a-8b80-69fb08505208 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:00.250270 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 154/295] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:00.257317 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c7cba-27b2-4406-aae8-a696912c45d6 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:00.257796 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c7cba-27b2-4406-aae8-a696912c45d6 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:00.257871 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c7cba-27b2-4406-aae8-a696912c45d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:00.277551 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-c75c7cba-27b2-4406-aae8-a696912c45d6 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:00.278753 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-c75c7cba-27b2-4406-aae8-a696912c45d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:00.352062 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 142/296] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:41:00.376210 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3758c02-f6fb-412a-8b80-69fb08505208 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:00.379848 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd291a1-ed75-4d18-99d5-826cf8bf7abe None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:00.380143 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd291a1-ed75-4d18-99d5-826cf8bf7abe None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:00.380416 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd291a1-ed75-4d18-99d5-826cf8bf7abe None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:00.381832 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 143/297] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:00.391946 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca687e06-595e-4977-9c85-bebcf2f65e15 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:00.392227 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca687e06-595e-4977-9c85-bebcf2f65e15 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:00.393115 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca687e06-595e-4977-9c85-bebcf2f65e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:00.413335 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-ca687e06-595e-4977-9c85-bebcf2f65e15 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:00.414503 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-ca687e06-595e-4977-9c85-bebcf2f65e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:00.488594 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 144/298] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:41:00.503920 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3758c02-f6fb-412a-8b80-69fb08505208 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:00.512485 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca687e06-595e-4977-9c85-bebcf2f65e15 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:00.547615 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e58269-e47c-44c3-b42c-45c238125264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:00.548432 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e58269-e47c-44c3-b42c-45c238125264 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:00.548744 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e58269-e47c-44c3-b42c-45c238125264 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:00.549085 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e58269-e47c-44c3-b42c-45c238125264 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:00.568357 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e58269-e47c-44c3-b42c-45c238125264 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:41:00.576321 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-32e58269-e47c-44c3-b42c-45c238125264 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:41:00.576321 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:00.576321 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:00.576321 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:00.576321 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:00.576321 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:00.576321 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:00.576321 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:00.576321 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:00.576321 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:00.576321 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:00.576321 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:00.576321 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:41:00.576321 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:41:00.576321 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:41:00.576321 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:41:00.577254 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:41:00.577254 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:41:00.577254 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:41:00.577254 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:41:00.577254 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:00.577254 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:00.577254 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:00.577254 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:00.577254 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:00.577254 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:00.577254 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:00.577254 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:00.577254 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:00.577254 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:00.577254 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:00.577254 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:00.578065 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:00.578065 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:00.578065 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:00.578065 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:00.578065 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:41:00.578065 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:41:00.578065 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:41:00.578065 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:41:00.578065 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:41:00.578065 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:41:00.578065 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:41:00.578065 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:00.578065 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 155/299] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:41:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:00.585694 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e58269-e47c-44c3-b42c-45c238125264 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:00.613834 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca687e06-595e-4977-9c85-bebcf2f65e15 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:00.648466 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95690ca8-d6dd-4dcd-ba8b-664cea4c679b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:00.649291 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95690ca8-d6dd-4dcd-ba8b-664cea4c679b None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:00.649565 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95690ca8-d6dd-4dcd-ba8b-664cea4c679b None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:00.649837 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95690ca8-d6dd-4dcd-ba8b-664cea4c679b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:00.660548 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95690ca8-d6dd-4dcd-ba8b-664cea4c679b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:41:00.668152 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-95690ca8-d6dd-4dcd-ba8b-664cea4c679b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 30 20:41:00.668152 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:00.668152 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:00.668152 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:00.668152 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:00.668152 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:00.668152 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:00.668152 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:00.668152 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:00.668152 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:00.668152 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:00.668152 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:00.668152 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:41:00.668152 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:41:00.668152 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:41:00.668152 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:41:00.669129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:41:00.669129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:41:00.669129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:41:00.669129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:41:00.669129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:00.669129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:00.669129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:00.669129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:00.669129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:00.669129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:00.669129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:00.669129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:00.669129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:00.669129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:00.669129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:00.669129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:00.669934 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:00.669934 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:00.669934 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:00.669934 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:00.669934 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:41:00.669934 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:41:00.669934 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:41:00.669934 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:41:00.669934 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:41:00.669934 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:41:00.669934 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Apr 30 20:41:00.669934 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:00.669934 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 145/300] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:41:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:41:00.674993 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639a2bb-dfe9-4597-bc0e-58bdc12a8717 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:00.675371 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639a2bb-dfe9-4597-bc0e-58bdc12a8717 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:00.675652 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639a2bb-dfe9-4597-bc0e-58bdc12a8717 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:00.677178 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 146/301] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:00.677803 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639a2bb-dfe9-4597-bc0e-58bdc12a8717 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:00.706754 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e58269-e47c-44c3-b42c-45c238125264 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:00.741409 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0bbe8-9e27-44c2-a66b-87c6100a2371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:00.742491 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0bbe8-9e27-44c2-a66b-87c6100a2371 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:00.742970 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0bbe8-9e27-44c2-a66b-87c6100a2371 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:00.743476 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0bbe8-9e27-44c2-a66b-87c6100a2371 None admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:00.744441 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f0bbe8-9e27-44c2-a66b-87c6100a2371 None admin] RBAC: Adding query filter params (name=member) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:00.744829 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f0bbe8-9e27-44c2-a66b-87c6100a2371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:00.746294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f0bbe8-9e27-44c2-a66b-87c6100a2371 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:00.755542 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 156/302] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Apr 30 20:41:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:00.756889 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fda49-88d5-4f68-962c-52bbc7351197 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:00.757227 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fda49-88d5-4f68-962c-52bbc7351197 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:00.757775 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fda49-88d5-4f68-962c-52bbc7351197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:00.775032 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-4d0fda49-88d5-4f68-962c-52bbc7351197 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:00.776245 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-4d0fda49-88d5-4f68-962c-52bbc7351197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:00.782844 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639a2bb-dfe9-4597-bc0e-58bdc12a8717 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:00.820628 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753ff7f-2b4e-4b07-827e-47f7bb65f561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:00.821325 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753ff7f-2b4e-4b07-827e-47f7bb65f561 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:00.821604 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753ff7f-2b4e-4b07-827e-47f7bb65f561 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:00.821873 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753ff7f-2b4e-4b07-827e-47f7bb65f561 None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:00.822601 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753ff7f-2b4e-4b07-827e-47f7bb65f561 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:00.822909 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753ff7f-2b4e-4b07-827e-47f7bb65f561 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:00.824299 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753ff7f-2b4e-4b07-827e-47f7bb65f561 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:00.837137 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 147/303] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Apr 30 20:41:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:00.837137 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753ff7f-2b4e-4b07-827e-47f7bb65f561 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:00.860116 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 157/304] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:41:00.860116 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fda49-88d5-4f68-962c-52bbc7351197 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:00.935657 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753ff7f-2b4e-4b07-827e-47f7bb65f561 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:00.959545 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fda49-88d5-4f68-962c-52bbc7351197 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:00.968866 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31063a-5b50-424a-af2e-96e0f6ba5b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:00.969769 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31063a-5b50-424a-af2e-96e0f6ba5b9b None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:00.970046 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31063a-5b50-424a-af2e-96e0f6ba5b9b None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:00.970322 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31063a-5b50-424a-af2e-96e0f6ba5b9b None admin] PATH_INFO: `/v3/users/3832f7db12ac4a4fad1c2a7616b590f6` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:00.972037 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31063a-5b50-424a-af2e-96e0f6ba5b9b None admin] RBAC: Authorizing `identity:get_user(user_id=3832f7db12ac4a4fad1c2a7616b590f6)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:00.973501 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31063a-5b50-424a-af2e-96e0f6ba5b9b None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:00.975272 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 148/305] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Apr 30 20:41:00 2022] GET /identity/v3/users/3832f7db12ac4a4fad1c2a7616b590f6 => generated 293 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:00.976204 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31063a-5b50-424a-af2e-96e0f6ba5b9b None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:00.999346 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71283e97-33cb-4064-b5f9-263bfee4e1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:01.000222 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71283e97-33cb-4064-b5f9-263bfee4e1e7 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:01.000503 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71283e97-33cb-4064-b5f9-263bfee4e1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:01.000772 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71283e97-33cb-4064-b5f9-263bfee4e1e7 None admin] PATH_INFO: `/v3/users/adf8e29909c0422b8eaf34680fd8fbd8` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:01.018651 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71283e97-33cb-4064-b5f9-263bfee4e1e7 None admin] RBAC: Authorizing `identity:get_user(user_id=adf8e29909c0422b8eaf34680fd8fbd8)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:01.020302 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71283e97-33cb-4064-b5f9-263bfee4e1e7 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:01.026759 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 158/306] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Apr 30 20:41:00 2022] GET /identity/v3/users/adf8e29909c0422b8eaf34680fd8fbd8 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:01.026759 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71283e97-33cb-4064-b5f9-263bfee4e1e7 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:01.074357 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31063a-5b50-424a-af2e-96e0f6ba5b9b None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:01.108623 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8afc7d-e4af-4495-bbef-a96168978cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:01.109440 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8afc7d-e4af-4495-bbef-a96168978cfd None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:01.109724 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8afc7d-e4af-4495-bbef-a96168978cfd None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:01.109995 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8afc7d-e4af-4495-bbef-a96168978cfd None admin] PATH_INFO: `/v3/domains/default` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:01.111180 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8afc7d-e4af-4495-bbef-a96168978cfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:01.112729 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8afc7d-e4af-4495-bbef-a96168978cfd None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:01.115458 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 149/307] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:01.115458 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8afc7d-e4af-4495-bbef-a96168978cfd None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:01.128122 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71283e97-33cb-4064-b5f9-263bfee4e1e7 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:01.162759 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37f786-b9c0-4eb9-acf8-3de65b75c0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:01.163614 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37f786-b9c0-4eb9-acf8-3de65b75c0e1 None admin] REQUEST_METHOD: `PUT` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:01.163891 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37f786-b9c0-4eb9-acf8-3de65b75c0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:01.164185 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37f786-b9c0-4eb9-acf8-3de65b75c0e1 None admin] PATH_INFO: `/v3/system/users/3832f7db12ac4a4fad1c2a7616b590f6/roles/375abc9f701c408ea332eaf2d8a2e086` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:01.165892 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37f786-b9c0-4eb9-acf8-3de65b75c0e1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3832f7db12ac4a4fad1c2a7616b590f6, role_id=375abc9f701c408ea332eaf2d8a2e086)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:01.167264 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37f786-b9c0-4eb9-acf8-3de65b75c0e1 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:01.211322 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8afc7d-e4af-4495-bbef-a96168978cfd None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:01.243983 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927ea1b-abc8-4072-98d6-8085509dd19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:01.244630 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927ea1b-abc8-4072-98d6-8085509dd19d None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:01.244922 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927ea1b-abc8-4072-98d6-8085509dd19d None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:01.245212 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927ea1b-abc8-4072-98d6-8085509dd19d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:01.246018 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927ea1b-abc8-4072-98d6-8085509dd19d None admin] RBAC: Adding query filter params (role.id=ca508df0c9124b8d97536818daba3aee, user.id=adf8e29909c0422b8eaf34680fd8fbd8, scope.system=all) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:01.246325 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927ea1b-abc8-4072-98d6-8085509dd19d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:01.247733 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927ea1b-abc8-4072-98d6-8085509dd19d None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:01.252608 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 150/308] 10.222.0.26 () {56 vars in 1308 bytes} [Sat Apr 30 20:41:01 2022] GET /identity/v3/role_assignments?user.id=adf8e29909c0422b8eaf34680fd8fbd8&scope.system=all&role.id=ca508df0c9124b8d97536818daba3aee => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:01.253385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927ea1b-abc8-4072-98d6-8085509dd19d None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:01.264478 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 159/309] 10.222.0.26 () {58 vars in 1334 bytes} [Sat Apr 30 20:41:01 2022] PUT /identity/v3/system/users/3832f7db12ac4a4fad1c2a7616b590f6/roles/375abc9f701c408ea332eaf2d8a2e086 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:41:01.379452 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927ea1b-abc8-4072-98d6-8085509dd19d None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:01.419156 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42858991-f2fc-4830-b71f-4807d24293e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:01.419846 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42858991-f2fc-4830-b71f-4807d24293e2 None admin] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:01.420128 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42858991-f2fc-4830-b71f-4807d24293e2 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:01.420557 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42858991-f2fc-4830-b71f-4807d24293e2 None admin] PATH_INFO: `/v3/groups` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:01.421322 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42858991-f2fc-4830-b71f-4807d24293e2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:01.422843 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42858991-f2fc-4830-b71f-4807d24293e2 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:01.519397 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 151/310] 10.222.0.26 () {60 vars in 1134 bytes} [Sat Apr 30 20:41:01 2022] POST /identity/v3/groups => generated 229 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:41:01.917293 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9948b45-1ca6-4326-8422-a612206f69f9 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:01.917953 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9948b45-1ca6-4326-8422-a612206f69f9 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:01.918434 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9948b45-1ca6-4326-8422-a612206f69f9 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:01.920023 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 160/311] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:01.925917 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d3f6e-62c8-4f8e-b857-76a5b55b6511 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:01.926426 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d3f6e-62c8-4f8e-b857-76a5b55b6511 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:01.926899 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d3f6e-62c8-4f8e-b857-76a5b55b6511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:01.943823 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-f69d3f6e-62c8-4f8e-b857-76a5b55b6511 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:01.945364 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-f69d3f6e-62c8-4f8e-b857-76a5b55b6511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:02.013181 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 152/312] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:41:02.038139 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9948b45-1ca6-4326-8422-a612206f69f9 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:02.142211 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9948b45-1ca6-4326-8422-a612206f69f9 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:02.181036 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a337a-626c-45b5-9cb4-47871ee71ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:02.182207 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a337a-626c-45b5-9cb4-47871ee71ea5 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:02.182680 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a337a-626c-45b5-9cb4-47871ee71ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:02.183140 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a337a-626c-45b5-9cb4-47871ee71ea5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:02.196354 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a337a-626c-45b5-9cb4-47871ee71ea5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:41:02.204260 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-a66a337a-626c-45b5-9cb4-47871ee71ea5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 30 20:41:02.204260 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:02.204260 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:02.204260 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:02.204260 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:02.204260 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:02.204260 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:02.204260 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:02.204260 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:02.204260 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:02.204260 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:02.204260 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:02.204260 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:41:02.204260 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:41:02.204260 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:41:02.204260 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:41:02.205360 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:41:02.205360 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:41:02.205360 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:41:02.205360 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:41:02.205360 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:02.205360 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:02.205360 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:02.205360 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:02.205360 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:02.205360 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:02.205360 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:02.205360 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:02.205360 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:02.205360 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:02.205360 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:02.205360 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:02.206164 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:02.206164 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:02.206164 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:02.206164 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:02.206164 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:41:02.206164 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:41:02.206164 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:41:02.206164 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:41:02.206164 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:41:02.206164 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:41:02.206164 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Apr 30 20:41:02.206164 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:02.208839 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 161/313] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:41:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:02.218187 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d3f6e-62c8-4f8e-b857-76a5b55b6511 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:02.320405 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d3f6e-62c8-4f8e-b857-76a5b55b6511 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:02.355198 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392dcce-7411-4cd0-b6a2-e60c45b5a62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:02.356231 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392dcce-7411-4cd0-b6a2-e60c45b5a62b None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:02.356708 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392dcce-7411-4cd0-b6a2-e60c45b5a62b None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:02.357207 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392dcce-7411-4cd0-b6a2-e60c45b5a62b None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:02.358177 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392dcce-7411-4cd0-b6a2-e60c45b5a62b None admin] RBAC: Adding query filter params (name=reader) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:02.358740 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392dcce-7411-4cd0-b6a2-e60c45b5a62b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:02.360313 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392dcce-7411-4cd0-b6a2-e60c45b5a62b None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:02.369483 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 153/314] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Apr 30 20:41:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:02.375131 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a337a-626c-45b5-9cb4-47871ee71ea5 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:02.479372 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a337a-626c-45b5-9cb4-47871ee71ea5 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:02.514617 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7784e0-2b99-4a46-b5ac-88c227d2d417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:02.515909 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7784e0-2b99-4a46-b5ac-88c227d2d417 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:02.516379 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7784e0-2b99-4a46-b5ac-88c227d2d417 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:02.516881 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7784e0-2b99-4a46-b5ac-88c227d2d417 None admin] PATH_INFO: `/v3/users/e3f57a8e4414452cbed58ec3a1428728` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:02.518439 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7784e0-2b99-4a46-b5ac-88c227d2d417 None admin] RBAC: Authorizing `identity:get_user(user_id=e3f57a8e4414452cbed58ec3a1428728)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:02.520149 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7784e0-2b99-4a46-b5ac-88c227d2d417 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:02.522430 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 162/315] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Apr 30 20:41:02 2022] GET /identity/v3/users/e3f57a8e4414452cbed58ec3a1428728 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:02.528097 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392dcce-7411-4cd0-b6a2-e60c45b5a62b None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:02.635524 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392dcce-7411-4cd0-b6a2-e60c45b5a62b None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:02.671646 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92700b1e-7257-4dee-9f1f-db314c18623a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:02.672675 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92700b1e-7257-4dee-9f1f-db314c18623a None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:02.673190 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92700b1e-7257-4dee-9f1f-db314c18623a None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:02.673718 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92700b1e-7257-4dee-9f1f-db314c18623a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:02.740929 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92700b1e-7257-4dee-9f1f-db314c18623a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:02.742739 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92700b1e-7257-4dee-9f1f-db314c18623a None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:02.849972 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 154/316] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:41:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:41:02.855994 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7784e0-2b99-4a46-b5ac-88c227d2d417 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:02.972758 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7784e0-2b99-4a46-b5ac-88c227d2d417 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:03.026546 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd64109-ec31-41f3-8ab2-a2efa446272e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:03.027903 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd64109-ec31-41f3-8ab2-a2efa446272e None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:03.028399 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd64109-ec31-41f3-8ab2-a2efa446272e None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:03.028866 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd64109-ec31-41f3-8ab2-a2efa446272e None admin] PATH_INFO: `/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:03.030241 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd64109-ec31-41f3-8ab2-a2efa446272e None admin] RBAC: Authorizing `identity:get_project(project_id=5141353bfd044a1ba7fb8ba70efe9a73)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:03.031885 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd64109-ec31-41f3-8ab2-a2efa446272e None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:03.034765 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 163/317] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:41:02 2022] GET /identity/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:03.041038 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92700b1e-7257-4dee-9f1f-db314c18623a None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:03.165462 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92700b1e-7257-4dee-9f1f-db314c18623a None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:03.204931 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530d16b-b258-4dec-827f-580ec5a05108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:03.204931 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530d16b-b258-4dec-827f-580ec5a05108 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:03.204931 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530d16b-b258-4dec-827f-580ec5a05108 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:03.204931 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530d16b-b258-4dec-827f-580ec5a05108 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:03.205630 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530d16b-b258-4dec-827f-580ec5a05108 None admin] RBAC: Adding query filter params (role.id=ca508df0c9124b8d97536818daba3aee, scope.project.id=5141353bfd044a1ba7fb8ba70efe9a73, user.id=e3f57a8e4414452cbed58ec3a1428728) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:03.206218 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530d16b-b258-4dec-827f-580ec5a05108 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:03.207600 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530d16b-b258-4dec-827f-580ec5a05108 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:03.216097 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 155/318] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Apr 30 20:41:03 2022] GET /identity/v3/role_assignments?user.id=e3f57a8e4414452cbed58ec3a1428728&scope.project.id=5141353bfd044a1ba7fb8ba70efe9a73&role.id=ca508df0c9124b8d97536818daba3aee => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:03.771812 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0783dd-1062-4f48-a5ef-5fe4ae7aa808 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:03.772320 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0783dd-1062-4f48-a5ef-5fe4ae7aa808 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:03.772396 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0783dd-1062-4f48-a5ef-5fe4ae7aa808 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:03.773905 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 164/319] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:03.778992 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618cf4b-d791-474e-82bb-6d1799e037d3 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:03.779407 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618cf4b-d791-474e-82bb-6d1799e037d3 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:03.779577 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618cf4b-d791-474e-82bb-6d1799e037d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:03.787049 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6518ffa-aeb1-4884-8c48-3153b87d6e02 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:03.787340 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6518ffa-aeb1-4884-8c48-3153b87d6e02 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:03.787624 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6518ffa-aeb1-4884-8c48-3153b87d6e02 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:03.789132 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 165/320] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:41:03.793891 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b61a19-760d-49d2-a085-dac13dea35c3 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:03.794179 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b61a19-760d-49d2-a085-dac13dea35c3 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:03.794456 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b61a19-760d-49d2-a085-dac13dea35c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:03.796680 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-4618cf4b-d791-474e-82bb-6d1799e037d3 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:03.797904 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-4618cf4b-d791-474e-82bb-6d1799e037d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:03.811909 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-19b61a19-760d-49d2-a085-dac13dea35c3 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:03.813176 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-19b61a19-760d-49d2-a085-dac13dea35c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:03.871101 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 156/321] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:41:03.882256 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 166/322] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:41:03.895831 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618cf4b-d791-474e-82bb-6d1799e037d3 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:03.905923 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b61a19-760d-49d2-a085-dac13dea35c3 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:03.994139 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618cf4b-d791-474e-82bb-6d1799e037d3 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:04.008822 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b61a19-760d-49d2-a085-dac13dea35c3 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:04.028715 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e947640-0297-469b-b7fe-f8821e7341c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:04.029474 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e947640-0297-469b-b7fe-f8821e7341c8 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:04.029752 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e947640-0297-469b-b7fe-f8821e7341c8 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:04.030025 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e947640-0297-469b-b7fe-f8821e7341c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:04.040493 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e947640-0297-469b-b7fe-f8821e7341c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:41:04.047130 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef725bb-f23b-4cda-8de1-f8e732660900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:04.047922 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef725bb-f23b-4cda-8de1-f8e732660900 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:04.048201 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef725bb-f23b-4cda-8de1-f8e732660900 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:04.048295 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-9e947640-0297-469b-b7fe-f8821e7341c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:41:04.048295 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:04.048295 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:04.048295 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:04.048295 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:04.048295 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:04.048295 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:04.048295 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:04.048295 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:04.048295 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:04.048295 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:04.048295 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:04.048295 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:41:04.048295 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:41:04.048295 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:41:04.048295 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:41:04.049829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:41:04.049829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:41:04.049829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:41:04.049829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:41:04.049829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:04.049829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:04.049829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:04.049829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:04.049829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:04.049829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:04.049829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:04.049829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:04.049829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:04.049829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:04.049829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:04.049829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:04.050604 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:04.050604 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:04.050604 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:04.050604 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:04.050604 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:41:04.050604 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:41:04.050604 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:41:04.050604 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:41:04.050604 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:41:04.050604 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:41:04.050604 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:41:04.050604 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:04.051216 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef725bb-f23b-4cda-8de1-f8e732660900 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:04.051282 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 157/323] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:41:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:04.055624 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e947640-0297-469b-b7fe-f8821e7341c8 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:04.061247 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef725bb-f23b-4cda-8de1-f8e732660900 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:41:04.069149 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-bef725bb-f23b-4cda-8de1-f8e732660900 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 30 20:41:04.069149 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:04.069149 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:04.069149 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:04.069149 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:04.069149 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:04.069149 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:04.069149 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:04.069149 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:04.069149 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:04.069149 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:04.069149 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:04.069149 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:41:04.069149 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:41:04.069149 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:41:04.069149 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:41:04.135792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:41:04.135792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:41:04.135792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:41:04.135792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:41:04.135792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:04.135792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:04.135792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:04.135792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:04.135792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:04.135792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:04.135792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:04.135792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:04.135792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:04.135792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:04.135792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:04.135792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:04.136631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:04.136631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:04.136631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:04.136631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:04.136631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:41:04.136631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:41:04.136631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:41:04.136631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:41:04.136631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:41:04.136631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:41:04.136631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Apr 30 20:41:04.136631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:04.136631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 167/324] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:41:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:41:04.136631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16302581-9fb6-4d8e-9464-5db9ddcebb6c None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:04.137458 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16302581-9fb6-4d8e-9464-5db9ddcebb6c None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:04.137458 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16302581-9fb6-4d8e-9464-5db9ddcebb6c None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:04.137458 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 168/325] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:41:04.137458 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16302581-9fb6-4d8e-9464-5db9ddcebb6c None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:04.153586 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e947640-0297-469b-b7fe-f8821e7341c8 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:04.178823 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16302581-9fb6-4d8e-9464-5db9ddcebb6c None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:04.184865 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbab71f-3537-462c-9240-de8f4413777d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:04.185565 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbab71f-3537-462c-9240-de8f4413777d None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:04.185849 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbab71f-3537-462c-9240-de8f4413777d None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:04.186122 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbab71f-3537-462c-9240-de8f4413777d None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:04.186849 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbab71f-3537-462c-9240-de8f4413777d None admin] RBAC: Adding query filter params (name=member) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:04.187154 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbab71f-3537-462c-9240-de8f4413777d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:04.188532 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbab71f-3537-462c-9240-de8f4413777d None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:04.196983 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 158/326] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Apr 30 20:41:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:41:04.198239 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a76c8-50f6-472c-8ddb-c1807f364e6f None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:04.198530 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a76c8-50f6-472c-8ddb-c1807f364e6f None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:04.198810 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a76c8-50f6-472c-8ddb-c1807f364e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:04.213074 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace90fac-b8de-49a9-b9b9-740276534ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:04.213739 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace90fac-b8de-49a9-b9b9-740276534ad2 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:04.214020 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace90fac-b8de-49a9-b9b9-740276534ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:04.214294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace90fac-b8de-49a9-b9b9-740276534ad2 None admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:04.215024 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace90fac-b8de-49a9-b9b9-740276534ad2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:04.215328 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace90fac-b8de-49a9-b9b9-740276534ad2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:04.215471 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-3f1a76c8-50f6-472c-8ddb-c1807f364e6f None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:04.216660 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-3f1a76c8-50f6-472c-8ddb-c1807f364e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:04.216756 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace90fac-b8de-49a9-b9b9-740276534ad2 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:04.224569 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 169/327] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Apr 30 20:41:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:04.225374 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace90fac-b8de-49a9-b9b9-740276534ad2 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:04.281477 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 159/328] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:41:04.282238 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a76c8-50f6-472c-8ddb-c1807f364e6f None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:04.325260 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace90fac-b8de-49a9-b9b9-740276534ad2 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:04.366416 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0e134-88e1-4b01-8476-a35121da7820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:04.367304 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0e134-88e1-4b01-8476-a35121da7820 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:04.367589 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0e134-88e1-4b01-8476-a35121da7820 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:04.367866 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0e134-88e1-4b01-8476-a35121da7820 None admin] PATH_INFO: `/v3/users/3832f7db12ac4a4fad1c2a7616b590f6` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:04.369122 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae0e134-88e1-4b01-8476-a35121da7820 None admin] RBAC: Authorizing `identity:get_user(user_id=3832f7db12ac4a4fad1c2a7616b590f6)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:04.370587 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae0e134-88e1-4b01-8476-a35121da7820 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:04.372243 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 170/329] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Apr 30 20:41:04 2022] GET /identity/v3/users/3832f7db12ac4a4fad1c2a7616b590f6 => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:04.373027 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0e134-88e1-4b01-8476-a35121da7820 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:04.375485 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a76c8-50f6-472c-8ddb-c1807f364e6f None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:04.409445 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1dcd0e-94db-41b5-a9c4-06ef6bdf0231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:04.410311 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1dcd0e-94db-41b5-a9c4-06ef6bdf0231 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:04.410596 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1dcd0e-94db-41b5-a9c4-06ef6bdf0231 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:04.410866 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1dcd0e-94db-41b5-a9c4-06ef6bdf0231 None admin] PATH_INFO: `/v3/users/adf8e29909c0422b8eaf34680fd8fbd8` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:04.412048 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1dcd0e-94db-41b5-a9c4-06ef6bdf0231 None admin] RBAC: Authorizing `identity:get_user(user_id=adf8e29909c0422b8eaf34680fd8fbd8)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:04.413529 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1dcd0e-94db-41b5-a9c4-06ef6bdf0231 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:04.415170 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 160/330] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Apr 30 20:41:04 2022] GET /identity/v3/users/adf8e29909c0422b8eaf34680fd8fbd8 => generated 293 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:04.415922 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1dcd0e-94db-41b5-a9c4-06ef6bdf0231 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:04.476705 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0e134-88e1-4b01-8476-a35121da7820 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:04.508145 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f6abe-562d-48ee-984c-7a996933509f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:04.508946 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f6abe-562d-48ee-984c-7a996933509f None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:04.509055 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1dcd0e-94db-41b5-a9c4-06ef6bdf0231 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:04.509231 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f6abe-562d-48ee-984c-7a996933509f None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:04.509501 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f6abe-562d-48ee-984c-7a996933509f None admin] PATH_INFO: `/v3/domains/default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:04.510631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f6abe-562d-48ee-984c-7a996933509f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:04.512185 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f6abe-562d-48ee-984c-7a996933509f None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:04.513819 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 171/331] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:04.514541 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f6abe-562d-48ee-984c-7a996933509f None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:04.542484 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d650af-d897-464a-9908-3d681079d6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:04.543146 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d650af-d897-464a-9908-3d681079d6e3 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:04.543401 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d650af-d897-464a-9908-3d681079d6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:04.543676 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d650af-d897-464a-9908-3d681079d6e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:04.544485 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d650af-d897-464a-9908-3d681079d6e3 None admin] RBAC: Adding query filter params (role.id=375abc9f701c408ea332eaf2d8a2e086, user.id=3832f7db12ac4a4fad1c2a7616b590f6, scope.system=all) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:04.544797 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d650af-d897-464a-9908-3d681079d6e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:04.546258 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d650af-d897-464a-9908-3d681079d6e3 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:04.558102 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 161/332] 10.222.0.26 () {56 vars in 1308 bytes} [Sat Apr 30 20:41:04 2022] GET /identity/v3/role_assignments?user.id=3832f7db12ac4a4fad1c2a7616b590f6&scope.system=all&role.id=375abc9f701c408ea332eaf2d8a2e086 => generated 510 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:04.558872 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d650af-d897-464a-9908-3d681079d6e3 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:04.616400 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f6abe-562d-48ee-984c-7a996933509f None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:04.652807 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727d900-fef9-4f8b-9313-733841e29970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:04.654034 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727d900-fef9-4f8b-9313-733841e29970 None admin] REQUEST_METHOD: `PUT` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:04.654316 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727d900-fef9-4f8b-9313-733841e29970 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:04.654585 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727d900-fef9-4f8b-9313-733841e29970 None admin] PATH_INFO: `/v3/system/users/adf8e29909c0422b8eaf34680fd8fbd8/roles/ca508df0c9124b8d97536818daba3aee` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:04.656171 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727d900-fef9-4f8b-9313-733841e29970 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=adf8e29909c0422b8eaf34680fd8fbd8, role_id=ca508df0c9124b8d97536818daba3aee)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:04.657639 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727d900-fef9-4f8b-9313-733841e29970 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:04.666060 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d650af-d897-464a-9908-3d681079d6e3 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:04.701062 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da3bc4-dced-4062-a9f5-b1f30feafd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:04.701737 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da3bc4-dced-4062-a9f5-b1f30feafd45 None admin] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:04.702020 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da3bc4-dced-4062-a9f5-b1f30feafd45 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:04.702292 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da3bc4-dced-4062-a9f5-b1f30feafd45 None admin] PATH_INFO: `/v3/groups` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:04.702986 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da3bc4-dced-4062-a9f5-b1f30feafd45 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:04.704451 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da3bc4-dced-4062-a9f5-b1f30feafd45 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:04.718472 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 172/333] 10.222.0.26 () {58 vars in 1334 bytes} [Sat Apr 30 20:41:04 2022] PUT /identity/v3/system/users/adf8e29909c0422b8eaf34680fd8fbd8/roles/ca508df0c9124b8d97536818daba3aee => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:41:04.793766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 162/334] 10.222.0.26 () {60 vars in 1134 bytes} [Sat Apr 30 20:41:04 2022] POST /identity/v3/groups => generated 226 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:41:07.166703 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96cf6fe-8f30-410f-809f-75dc699cb9a3 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:07.167203 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96cf6fe-8f30-410f-809f-75dc699cb9a3 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:07.167203 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96cf6fe-8f30-410f-809f-75dc699cb9a3 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:07.169041 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 173/335] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:07.174115 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78213c5b-e9fd-4024-8a10-6c831844b131 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:07.174550 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78213c5b-e9fd-4024-8a10-6c831844b131 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:07.174654 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78213c5b-e9fd-4024-8a10-6c831844b131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:07.194541 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-78213c5b-e9fd-4024-8a10-6c831844b131 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:07.195789 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-78213c5b-e9fd-4024-8a10-6c831844b131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:07.289796 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 163/336] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:41:07.336398 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96cf6fe-8f30-410f-809f-75dc699cb9a3 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:07.462522 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96cf6fe-8f30-410f-809f-75dc699cb9a3 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:07.503978 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1967f8-cf78-48af-8a43-330c48638596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:07.504772 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1967f8-cf78-48af-8a43-330c48638596 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:07.505080 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1967f8-cf78-48af-8a43-330c48638596 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:07.505350 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1967f8-cf78-48af-8a43-330c48638596 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:07.521074 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1967f8-cf78-48af-8a43-330c48638596 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:41:07.534936 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-6f1967f8-cf78-48af-8a43-330c48638596 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 30 20:41:07.534936 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:07.534936 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:07.534936 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:07.534936 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:07.534936 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:07.534936 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:07.534936 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:07.534936 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:07.534936 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:07.534936 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:07.534936 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:07.534936 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:41:07.534936 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:41:07.534936 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:41:07.534936 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:41:07.535865 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:41:07.535865 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:41:07.535865 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:41:07.535865 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:41:07.535865 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:07.535865 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:07.535865 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:07.535865 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:07.535865 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:07.535865 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:07.535865 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:07.535865 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:07.535865 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:07.535865 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:07.535865 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:07.535865 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:07.536676 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:07.536676 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:07.536676 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:07.536676 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:07.536676 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:41:07.536676 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:41:07.536676 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:41:07.536676 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:41:07.536676 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:41:07.536676 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:41:07.536676 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Apr 30 20:41:07.536676 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:07.536676 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 174/337] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:41:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:07.542346 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78213c5b-e9fd-4024-8a10-6c831844b131 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:07.572654 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145527e-b67d-4d8b-b343-43e5eaf3d9ed None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:07.573003 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145527e-b67d-4d8b-b343-43e5eaf3d9ed None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:07.573245 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145527e-b67d-4d8b-b343-43e5eaf3d9ed None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:07.574825 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 175/338] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:07.580102 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61055a1-d7da-4aa1-b67b-7ffe881f9402 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:07.580378 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61055a1-d7da-4aa1-b67b-7ffe881f9402 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:07.580815 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61055a1-d7da-4aa1-b67b-7ffe881f9402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:07.619389 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-a61055a1-d7da-4aa1-b67b-7ffe881f9402 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:07.620701 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-a61055a1-d7da-4aa1-b67b-7ffe881f9402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:07.711534 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78213c5b-e9fd-4024-8a10-6c831844b131 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:07.726627 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 176/339] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:41:07.752138 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5badae-2fb2-4b9c-b277-cc7e4c666ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:07.753183 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5badae-2fb2-4b9c-b277-cc7e4c666ef0 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:07.753635 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5badae-2fb2-4b9c-b277-cc7e4c666ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:07.757098 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5badae-2fb2-4b9c-b277-cc7e4c666ef0 None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:07.757098 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5badae-2fb2-4b9c-b277-cc7e4c666ef0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:07.757098 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5badae-2fb2-4b9c-b277-cc7e4c666ef0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:07.757098 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5badae-2fb2-4b9c-b277-cc7e4c666ef0 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:07.766601 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 164/340] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Apr 30 20:41:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:07.772403 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61055a1-d7da-4aa1-b67b-7ffe881f9402 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:07.774462 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5badae-2fb2-4b9c-b277-cc7e4c666ef0 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:07.896975 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5badae-2fb2-4b9c-b277-cc7e4c666ef0 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:07.932607 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c626262-497e-4ef8-a123-fdaef4fd27ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:07.933694 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c626262-497e-4ef8-a123-fdaef4fd27ed None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:07.934121 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61055a1-d7da-4aa1-b67b-7ffe881f9402 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:07.934354 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c626262-497e-4ef8-a123-fdaef4fd27ed None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:07.934774 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c626262-497e-4ef8-a123-fdaef4fd27ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:07.947156 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c626262-497e-4ef8-a123-fdaef4fd27ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:41:07.956256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-8c626262-497e-4ef8-a123-fdaef4fd27ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:41:07.956256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:07.956256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:07.956256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:07.956256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:07.956256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:07.956256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:07.956256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:07.956256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:07.956256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:07.956256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:07.956256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:07.956256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:41:07.956256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:41:07.956256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:41:07.956256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:41:07.958734 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:41:07.958734 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:41:07.958734 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:41:07.958734 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:41:07.958734 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:07.958734 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:07.958734 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:07.958734 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:07.958734 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:07.958734 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:07.958734 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:07.958734 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:07.958734 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:07.958734 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:07.958734 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:07.958734 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:07.959720 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:07.959720 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:07.959720 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:07.959720 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:07.959720 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:41:07.959720 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:41:07.959720 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:41:07.959720 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:41:07.959720 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:41:07.959720 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:41:07.959720 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:41:07.959720 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:07.961441 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 165/341] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:41:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:41:07.967489 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c626262-497e-4ef8-a123-fdaef4fd27ed None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:08.034668 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1761c44-0151-47d1-afb0-09a7d086cf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:08.036241 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1761c44-0151-47d1-afb0-09a7d086cf8f None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:08.036643 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1761c44-0151-47d1-afb0-09a7d086cf8f None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:08.037055 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1761c44-0151-47d1-afb0-09a7d086cf8f None admin] PATH_INFO: `/v3/users/adf8e29909c0422b8eaf34680fd8fbd8` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:08.038746 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1761c44-0151-47d1-afb0-09a7d086cf8f None admin] RBAC: Authorizing `identity:get_user(user_id=adf8e29909c0422b8eaf34680fd8fbd8)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:08.040406 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1761c44-0151-47d1-afb0-09a7d086cf8f None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:08.043167 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 177/342] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Apr 30 20:41:07 2022] GET /identity/v3/users/adf8e29909c0422b8eaf34680fd8fbd8 => generated 293 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:08.047814 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1761c44-0151-47d1-afb0-09a7d086cf8f None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:08.088251 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c626262-497e-4ef8-a123-fdaef4fd27ed None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:08.129935 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e387fd9-7fc0-47d9-a83b-1213b76337e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:08.131014 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e387fd9-7fc0-47d9-a83b-1213b76337e0 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:08.131446 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e387fd9-7fc0-47d9-a83b-1213b76337e0 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:08.131897 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e387fd9-7fc0-47d9-a83b-1213b76337e0 None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:08.132797 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e387fd9-7fc0-47d9-a83b-1213b76337e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:08.133279 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e387fd9-7fc0-47d9-a83b-1213b76337e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:08.135750 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e387fd9-7fc0-47d9-a83b-1213b76337e0 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:08.146650 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 166/343] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Apr 30 20:41:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:08.152454 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e387fd9-7fc0-47d9-a83b-1213b76337e0 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:08.236469 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1761c44-0151-47d1-afb0-09a7d086cf8f None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:08.267920 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e387fd9-7fc0-47d9-a83b-1213b76337e0 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:08.291280 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056038d-6f9a-4551-aae4-872cf9c6cbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:08.291843 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056038d-6f9a-4551-aae4-872cf9c6cbf8 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:08.292230 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056038d-6f9a-4551-aae4-872cf9c6cbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:08.292613 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056038d-6f9a-4551-aae4-872cf9c6cbf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:08.293583 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056038d-6f9a-4551-aae4-872cf9c6cbf8 None admin] RBAC: Adding query filter params (role.id=ca508df0c9124b8d97536818daba3aee, user.id=adf8e29909c0422b8eaf34680fd8fbd8, scope.system=all) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:08.294001 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056038d-6f9a-4551-aae4-872cf9c6cbf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:08.295597 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056038d-6f9a-4551-aae4-872cf9c6cbf8 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:08.311964 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515d660-2e2b-417c-8da5-d1f732ce533d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:08.313044 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515d660-2e2b-417c-8da5-d1f732ce533d None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:08.313479 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515d660-2e2b-417c-8da5-d1f732ce533d None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:08.313796 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 178/344] 10.222.0.26 () {56 vars in 1308 bytes} [Sat Apr 30 20:41:08 2022] GET /identity/v3/role_assignments?user.id=adf8e29909c0422b8eaf34680fd8fbd8&scope.system=all&role.id=ca508df0c9124b8d97536818daba3aee => generated 510 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:41:08.314074 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515d660-2e2b-417c-8da5-d1f732ce533d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:08.316311 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f3fdc-703c-443f-a08e-96b8fd294de8 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:08.316712 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f3fdc-703c-443f-a08e-96b8fd294de8 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:08.317117 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f3fdc-703c-443f-a08e-96b8fd294de8 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:08.318795 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 179/345] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:08.324635 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9f644-3bde-40a6-8933-389ea3c5def7 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:08.325294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9f644-3bde-40a6-8933-389ea3c5def7 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:08.325776 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9f644-3bde-40a6-8933-389ea3c5def7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:08.362976 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-5eb9f644-3bde-40a6-8933-389ea3c5def7 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:08.364635 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-5eb9f644-3bde-40a6-8933-389ea3c5def7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:08.398378 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515d660-2e2b-417c-8da5-d1f732ce533d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:08.405058 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515d660-2e2b-417c-8da5-d1f732ce533d None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:08.464744 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 180/346] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:41:08.498231 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9f644-3bde-40a6-8933-389ea3c5def7 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:08.547140 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 167/347] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:41:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 30 20:41:08.551415 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515d660-2e2b-417c-8da5-d1f732ce533d None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:08.640365 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9f644-3bde-40a6-8933-389ea3c5def7 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:08.677514 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515d660-2e2b-417c-8da5-d1f732ce533d None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:08.695784 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae79890-1a24-49ad-9097-3325107e4ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:08.696950 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae79890-1a24-49ad-9097-3325107e4ffe None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:08.697424 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae79890-1a24-49ad-9097-3325107e4ffe None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:08.697912 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae79890-1a24-49ad-9097-3325107e4ffe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:08.712204 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae79890-1a24-49ad-9097-3325107e4ffe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:41:08.728524 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-fae79890-1a24-49ad-9097-3325107e4ffe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:41:08.728524 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:08.728524 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:08.728524 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:08.728524 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:08.728524 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:08.728524 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:08.728524 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:08.728524 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:08.728524 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:08.728524 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:08.728524 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:08.728524 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:41:08.728524 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:41:08.728524 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:41:08.728524 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:41:08.729528 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:41:08.729528 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:41:08.729528 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:41:08.729528 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:41:08.729528 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:08.729528 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:08.729528 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:08.729528 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:08.729528 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:08.729528 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:08.729528 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:08.729528 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:08.729528 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:08.729528 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:08.729528 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:08.729528 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:08.730347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:08.730347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:08.730347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:08.730347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:08.730347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:41:08.730347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:41:08.730347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:41:08.730347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:41:08.730347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:41:08.730347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:41:08.730347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:41:08.730347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:08.732576 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 181/348] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Apr 30 20:41:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:08.741457 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae79890-1a24-49ad-9097-3325107e4ffe None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:08.775537 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82524c5c-88bd-4600-b0c3-463d876eb78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:08.776453 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82524c5c-88bd-4600-b0c3-463d876eb78e None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:08.776672 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82524c5c-88bd-4600-b0c3-463d876eb78e None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:08.776968 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82524c5c-88bd-4600-b0c3-463d876eb78e None admin] PATH_INFO: `/v3/projects/b65984e2c7ae400c829003b7ab39d8e2` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:08.781689 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82524c5c-88bd-4600-b0c3-463d876eb78e None admin] RBAC: Authorizing `identity:get_project(project_id=b65984e2c7ae400c829003b7ab39d8e2)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:08.783207 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82524c5c-88bd-4600-b0c3-463d876eb78e None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:08.785441 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 168/349] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:41:08 2022] GET /identity/v3/projects/b65984e2c7ae400c829003b7ab39d8e2 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:08.786702 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf4c7d-395a-40ea-ad89-58cd769e668f None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:08.786987 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf4c7d-395a-40ea-ad89-58cd769e668f None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:08.787262 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf4c7d-395a-40ea-ad89-58cd769e668f None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:08.788507 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 169/350] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:08.793938 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef2110-3eb7-4593-a2f2-1bd0f12f6d99 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:08.794226 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef2110-3eb7-4593-a2f2-1bd0f12f6d99 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:08.794511 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef2110-3eb7-4593-a2f2-1bd0f12f6d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:08.817629 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-aeef2110-3eb7-4593-a2f2-1bd0f12f6d99 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:08.823338 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-aeef2110-3eb7-4593-a2f2-1bd0f12f6d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:08.883620 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae79890-1a24-49ad-9097-3325107e4ffe None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:08.913858 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 170/351] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Apr 30 20:41:08.914710 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef2110-3eb7-4593-a2f2-1bd0f12f6d99 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:08.930488 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d8cb4-6a08-466d-bd11-0c35d1fe85e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:08.931676 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d8cb4-6a08-466d-bd11-0c35d1fe85e9 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:08.932476 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d8cb4-6a08-466d-bd11-0c35d1fe85e9 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:08.932956 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d8cb4-6a08-466d-bd11-0c35d1fe85e9 None admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:08.933864 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d8cb4-6a08-466d-bd11-0c35d1fe85e9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:08.934323 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d8cb4-6a08-466d-bd11-0c35d1fe85e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:08.935981 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d8cb4-6a08-466d-bd11-0c35d1fe85e9 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:08.948444 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 182/352] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:41:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:08.949649 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d8cb4-6a08-466d-bd11-0c35d1fe85e9 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:09.042008 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef2110-3eb7-4593-a2f2-1bd0f12f6d99 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:09.061990 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d8cb4-6a08-466d-bd11-0c35d1fe85e9 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:09.077121 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d0e03-8a19-476d-b78a-b5bb8ebdc055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:09.077908 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d0e03-8a19-476d-b78a-b5bb8ebdc055 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:09.078186 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d0e03-8a19-476d-b78a-b5bb8ebdc055 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:09.078454 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d0e03-8a19-476d-b78a-b5bb8ebdc055 None admin] PATH_INFO: `/v3/groups/9ddd9cff0769482e8b596c8f6f6deac6` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:09.086971 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d0e03-8a19-476d-b78a-b5bb8ebdc055 None admin] RBAC: Authorizing `identity:get_group(group_id=9ddd9cff0769482e8b596c8f6f6deac6)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:09.088433 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d0e03-8a19-476d-b78a-b5bb8ebdc055 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:09.090336 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 171/353] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Apr 30 20:41:08 2022] GET /identity/v3/groups/9ddd9cff0769482e8b596c8f6f6deac6 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:09.090934 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d0e03-8a19-476d-b78a-b5bb8ebdc055 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:09.099160 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b7893-2026-462c-81ac-37496c5d6bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:09.099999 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b7893-2026-462c-81ac-37496c5d6bab None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:09.100278 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b7893-2026-462c-81ac-37496c5d6bab None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:09.100830 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b7893-2026-462c-81ac-37496c5d6bab None admin] PATH_INFO: `/v3/roles/member` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:09.112673 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b7893-2026-462c-81ac-37496c5d6bab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:41:09.120567 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-2e3b7893-2026-462c-81ac-37496c5d6bab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:41:09.120567 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:09.120567 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:09.120567 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:09.120567 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:09.120567 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:09.120567 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:09.120567 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:09.120567 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:09.120567 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:09.120567 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:09.120567 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:09.120567 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:41:09.120567 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:41:09.120567 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:41:09.120567 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:41:09.121509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:41:09.121509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:41:09.121509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:41:09.121509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:41:09.121509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:09.121509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:09.121509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:09.121509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:09.121509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:09.121509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:09.121509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:09.121509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:09.121509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:09.121509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:09.121509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:09.121509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:09.122291 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:09.122291 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:09.122291 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:09.122291 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:09.122291 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:41:09.122291 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:41:09.122291 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:41:09.122291 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:41:09.122291 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:41:09.122291 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:41:09.122291 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:41:09.122291 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:09.122291 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 183/354] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:41:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:09.123645 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b7893-2026-462c-81ac-37496c5d6bab None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:09.194039 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d0e03-8a19-476d-b78a-b5bb8ebdc055 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:09.228035 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b7893-2026-462c-81ac-37496c5d6bab None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:09.229772 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e667f-f375-4004-8c1e-2790d1455842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:09.230432 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e667f-f375-4004-8c1e-2790d1455842 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:09.230714 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e667f-f375-4004-8c1e-2790d1455842 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:09.230991 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e667f-f375-4004-8c1e-2790d1455842 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:09.263717 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e637c7b-dd3b-4895-9933-aead7d07adad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:09.264372 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e637c7b-dd3b-4895-9933-aead7d07adad None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:09.264638 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e637c7b-dd3b-4895-9933-aead7d07adad None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:09.264929 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e637c7b-dd3b-4895-9933-aead7d07adad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:09.265886 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e637c7b-dd3b-4895-9933-aead7d07adad None admin] RBAC: Adding query filter params (group.id=9ddd9cff0769482e8b596c8f6f6deac6, role.id=375abc9f701c408ea332eaf2d8a2e086, scope.project.id=b65984e2c7ae400c829003b7ab39d8e2) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:09.266197 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e637c7b-dd3b-4895-9933-aead7d07adad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:09.268562 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e637c7b-dd3b-4895-9933-aead7d07adad None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:09.274878 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 184/355] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Apr 30 20:41:09 2022] GET /identity/v3/role_assignments?group.id=9ddd9cff0769482e8b596c8f6f6deac6&scope.project.id=b65984e2c7ae400c829003b7ab39d8e2&role.id=375abc9f701c408ea332eaf2d8a2e086 => generated 260 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:09.275762 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e637c7b-dd3b-4895-9933-aead7d07adad None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:09.303220 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e667f-f375-4004-8c1e-2790d1455842 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:09.304708 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e667f-f375-4004-8c1e-2790d1455842 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:09.385729 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e637c7b-dd3b-4895-9933-aead7d07adad None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:09.410745 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 172/356] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:41:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:41:09.416468 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e667f-f375-4004-8c1e-2790d1455842 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:09.423241 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c06a9-57bc-4ef9-8ec7-1a22aeced6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:09.424686 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c06a9-57bc-4ef9-8ec7-1a22aeced6da None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:09.425244 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c06a9-57bc-4ef9-8ec7-1a22aeced6da None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:09.425692 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c06a9-57bc-4ef9-8ec7-1a22aeced6da None admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:09.426580 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c06a9-57bc-4ef9-8ec7-1a22aeced6da None admin] RBAC: Adding query filter params (name=member) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:09.427565 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c06a9-57bc-4ef9-8ec7-1a22aeced6da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:09.429490 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c06a9-57bc-4ef9-8ec7-1a22aeced6da None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:09.477826 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 185/357] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Apr 30 20:41:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:09.477826 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c06a9-57bc-4ef9-8ec7-1a22aeced6da None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:09.533582 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e667f-f375-4004-8c1e-2790d1455842 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:09.577820 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f544cff-de98-464b-a576-5525d8c88a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:09.579086 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f544cff-de98-464b-a576-5525d8c88a3e None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:09.579568 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f544cff-de98-464b-a576-5525d8c88a3e None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:09.580939 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f544cff-de98-464b-a576-5525d8c88a3e None admin] PATH_INFO: `/v3/projects/b65984e2c7ae400c829003b7ab39d8e2` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:09.582334 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c06a9-57bc-4ef9-8ec7-1a22aeced6da None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:09.583011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f544cff-de98-464b-a576-5525d8c88a3e None admin] RBAC: Authorizing `identity:get_project(project_id=b65984e2c7ae400c829003b7ab39d8e2)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:09.584675 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f544cff-de98-464b-a576-5525d8c88a3e None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:09.587193 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 173/358] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:41:09 2022] GET /identity/v3/projects/b65984e2c7ae400c829003b7ab39d8e2 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:09.594972 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f544cff-de98-464b-a576-5525d8c88a3e None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:09.635723 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f468c0-a4f8-4361-b7af-0438e0b50888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:09.636832 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f468c0-a4f8-4361-b7af-0438e0b50888 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:09.637457 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f468c0-a4f8-4361-b7af-0438e0b50888 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:09.637937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f468c0-a4f8-4361-b7af-0438e0b50888 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:09.712454 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f544cff-de98-464b-a576-5525d8c88a3e None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:09.715336 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f468c0-a4f8-4361-b7af-0438e0b50888 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:09.717112 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f468c0-a4f8-4361-b7af-0438e0b50888 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:09.748699 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f00b5-e081-4fec-b0b8-2845c275c54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:09.749652 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f00b5-e081-4fec-b0b8-2845c275c54e None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:09.749871 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f00b5-e081-4fec-b0b8-2845c275c54e None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:09.750151 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f00b5-e081-4fec-b0b8-2845c275c54e None admin] PATH_INFO: `/v3/groups/9ddd9cff0769482e8b596c8f6f6deac6` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:09.751344 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f00b5-e081-4fec-b0b8-2845c275c54e None admin] RBAC: Authorizing `identity:get_group(group_id=9ddd9cff0769482e8b596c8f6f6deac6)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:09.753918 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f00b5-e081-4fec-b0b8-2845c275c54e None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:09.760441 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 174/359] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Apr 30 20:41:09 2022] GET /identity/v3/groups/9ddd9cff0769482e8b596c8f6f6deac6 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:09.761471 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f00b5-e081-4fec-b0b8-2845c275c54e None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:09.849196 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 186/360] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:41:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 30 20:41:09.851082 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02ba66-221b-4374-b1c5-3044710dd558 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:09.851539 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02ba66-221b-4374-b1c5-3044710dd558 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:09.852006 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02ba66-221b-4374-b1c5-3044710dd558 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:09.854310 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 187/361] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:09.855192 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02ba66-221b-4374-b1c5-3044710dd558 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:09.882860 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f00b5-e081-4fec-b0b8-2845c275c54e None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:09.928204 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6475db2-26bc-4d80-b538-c3deee42221d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:09.929241 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6475db2-26bc-4d80-b538-c3deee42221d None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:09.929698 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6475db2-26bc-4d80-b538-c3deee42221d None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:09.930171 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6475db2-26bc-4d80-b538-c3deee42221d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:09.931213 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6475db2-26bc-4d80-b538-c3deee42221d None admin] RBAC: Adding query filter params (group.id=9ddd9cff0769482e8b596c8f6f6deac6, role.id=f76bb9b1c47a4fbfa232de16b0b4a0d5, scope.project.id=b65984e2c7ae400c829003b7ab39d8e2) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:09.931733 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6475db2-26bc-4d80-b538-c3deee42221d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:09.934142 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6475db2-26bc-4d80-b538-c3deee42221d None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:09.940259 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 175/362] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Apr 30 20:41:09 2022] GET /identity/v3/role_assignments?group.id=9ddd9cff0769482e8b596c8f6f6deac6&scope.project.id=b65984e2c7ae400c829003b7ab39d8e2&role.id=f76bb9b1c47a4fbfa232de16b0b4a0d5 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:09.941980 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4902565-77dd-4280-8256-835019162938 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:09.942469 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4902565-77dd-4280-8256-835019162938 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:09.943886 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4902565-77dd-4280-8256-835019162938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:09.964695 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-e4902565-77dd-4280-8256-835019162938 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:09.966800 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-e4902565-77dd-4280-8256-835019162938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:09.998263 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02ba66-221b-4374-b1c5-3044710dd558 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:10.037594 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c833328-a738-4c95-8483-f4452fada3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:10.038925 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c833328-a738-4c95-8483-f4452fada3bb None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:10.039457 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c833328-a738-4c95-8483-f4452fada3bb None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:10.039926 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c833328-a738-4c95-8483-f4452fada3bb None admin] PATH_INFO: `/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:10.041935 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c833328-a738-4c95-8483-f4452fada3bb None admin] RBAC: Authorizing `identity:get_project(project_id=5141353bfd044a1ba7fb8ba70efe9a73)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:10.044733 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c833328-a738-4c95-8483-f4452fada3bb None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:10.046797 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 188/363] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:41:09 2022] GET /identity/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:10.052827 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c833328-a738-4c95-8483-f4452fada3bb None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:10.059498 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 176/364] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:41:10.088256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4902565-77dd-4280-8256-835019162938 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:10.197884 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4902565-77dd-4280-8256-835019162938 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:10.219983 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c833328-a738-4c95-8483-f4452fada3bb None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:10.254381 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e1030-2bb4-43ce-b663-69a46b7f614b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:10.255220 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e1030-2bb4-43ce-b663-69a46b7f614b None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:10.255503 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e1030-2bb4-43ce-b663-69a46b7f614b None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:10.255776 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e1030-2bb4-43ce-b663-69a46b7f614b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:10.275431 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e1030-2bb4-43ce-b663-69a46b7f614b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:41:10.280538 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b4f42-a332-4368-a189-4dd91c107068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:10.281497 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b4f42-a332-4368-a189-4dd91c107068 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:10.281779 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b4f42-a332-4368-a189-4dd91c107068 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:10.282057 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b4f42-a332-4368-a189-4dd91c107068 None admin] PATH_INFO: `/v3/groups/9ddd9cff0769482e8b596c8f6f6deac6` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:10.283514 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b4f42-a332-4368-a189-4dd91c107068 None admin] RBAC: Authorizing `identity:get_group(group_id=9ddd9cff0769482e8b596c8f6f6deac6)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:10.284808 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-408e1030-2bb4-43ce-b663-69a46b7f614b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:41:10.284808 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:10.284808 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:10.284808 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:10.284808 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:10.284808 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:10.284808 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:10.284808 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:10.284808 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:10.284808 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:10.284808 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:10.284808 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:10.284808 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:41:10.284808 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:41:10.284808 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:41:10.284808 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:41:10.285689 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:41:10.285689 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:41:10.285689 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:41:10.285689 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:41:10.285689 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:10.285689 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:10.285689 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:10.285689 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:10.285689 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:10.285689 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:10.285689 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:10.285689 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:10.285689 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:10.285689 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:10.285689 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:10.285689 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:10.287147 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:10.287147 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:10.287147 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:10.287147 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:10.287147 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:41:10.287147 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:41:10.287147 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:41:10.287147 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:41:10.287147 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:41:10.287147 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:41:10.287147 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:41:10.287147 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:10.287975 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b4f42-a332-4368-a189-4dd91c107068 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:10.288053 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 177/365] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Apr 30 20:41:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:41:10.288120 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 189/366] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Apr 30 20:41:10 2022] GET /identity/v3/groups/9ddd9cff0769482e8b596c8f6f6deac6 => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:10.288182 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a56eb5-7c89-4db6-adc9-0832361a7c87 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:10.288182 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a56eb5-7c89-4db6-adc9-0832361a7c87 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:10.288182 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a56eb5-7c89-4db6-adc9-0832361a7c87 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:10.292737 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 178/367] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:10.294683 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b4f42-a332-4368-a189-4dd91c107068 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:10.295918 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a56eb5-7c89-4db6-adc9-0832361a7c87 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:10.409313 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b4f42-a332-4368-a189-4dd91c107068 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:10.442377 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a56eb5-7c89-4db6-adc9-0832361a7c87 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:10.456494 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deec55c-1dfb-4358-847c-6db693a215be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:10.457435 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deec55c-1dfb-4358-847c-6db693a215be None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:10.457728 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deec55c-1dfb-4358-847c-6db693a215be None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:10.458009 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deec55c-1dfb-4358-847c-6db693a215be None admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:10.458769 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deec55c-1dfb-4358-847c-6db693a215be None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:10.459082 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deec55c-1dfb-4358-847c-6db693a215be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:10.461248 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deec55c-1dfb-4358-847c-6db693a215be None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:10.473664 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 190/368] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:41:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:10.475249 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3783927-4bf7-48d1-8bab-e5084daf177c None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:10.475535 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3783927-4bf7-48d1-8bab-e5084daf177c None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:10.476227 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3783927-4bf7-48d1-8bab-e5084daf177c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:10.491481 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce3a0d-c02f-433b-b13a-73d5f2a3c657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:10.492159 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce3a0d-c02f-433b-b13a-73d5f2a3c657 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:10.492447 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce3a0d-c02f-433b-b13a-73d5f2a3c657 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:10.492725 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce3a0d-c02f-433b-b13a-73d5f2a3c657 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:10.493599 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce3a0d-c02f-433b-b13a-73d5f2a3c657 None admin] RBAC: Adding query filter params (group.id=9ddd9cff0769482e8b596c8f6f6deac6, role.id=375abc9f701c408ea332eaf2d8a2e086, scope.project.id=5141353bfd044a1ba7fb8ba70efe9a73) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:10.494466 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce3a0d-c02f-433b-b13a-73d5f2a3c657 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:10.496286 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce3a0d-c02f-433b-b13a-73d5f2a3c657 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:10.499482 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-e3783927-4bf7-48d1-8bab-e5084daf177c None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:10.500679 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-e3783927-4bf7-48d1-8bab-e5084daf177c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:10.503068 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 179/369] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Apr 30 20:41:10 2022] GET /identity/v3/role_assignments?group.id=9ddd9cff0769482e8b596c8f6f6deac6&scope.project.id=5141353bfd044a1ba7fb8ba70efe9a73&role.id=375abc9f701c408ea332eaf2d8a2e086 => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:10.503837 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce3a0d-c02f-433b-b13a-73d5f2a3c657 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:10.623665 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 191/370] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:41:10.634106 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce3a0d-c02f-433b-b13a-73d5f2a3c657 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:10.662591 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3783927-4bf7-48d1-8bab-e5084daf177c None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:10.692869 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa853934-2f91-47f5-ac5d-35007a28fcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:10.693555 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa853934-2f91-47f5-ac5d-35007a28fcf4 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:10.693831 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa853934-2f91-47f5-ac5d-35007a28fcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:10.694106 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa853934-2f91-47f5-ac5d-35007a28fcf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:10.812756 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa853934-2f91-47f5-ac5d-35007a28fcf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:10.814373 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa853934-2f91-47f5-ac5d-35007a28fcf4 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:10.824928 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3783927-4bf7-48d1-8bab-e5084daf177c None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:10.865642 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7395b-d11b-43f6-af47-8e5631004f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:10.866459 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7395b-d11b-43f6-af47-8e5631004f27 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:10.866744 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7395b-d11b-43f6-af47-8e5631004f27 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:10.867025 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7395b-d11b-43f6-af47-8e5631004f27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:10.881305 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7395b-d11b-43f6-af47-8e5631004f27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:41:10.893891 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-ece7395b-d11b-43f6-af47-8e5631004f27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:41:10.893891 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:10.893891 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:10.893891 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:10.893891 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:10.893891 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:10.893891 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:10.893891 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:10.893891 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:10.893891 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:10.893891 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:10.893891 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:10.893891 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:41:10.893891 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:41:10.893891 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:41:10.893891 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:41:10.894802 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:41:10.894802 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:41:10.894802 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:41:10.894802 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:41:10.894802 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:10.894802 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:10.894802 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:10.894802 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:10.894802 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:10.894802 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:10.894802 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:10.894802 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:10.894802 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:10.894802 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:10.894802 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:10.894802 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:10.896021 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:10.896021 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:10.896021 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:10.896021 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:10.896021 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:41:10.896021 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:41:10.896021 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:41:10.896021 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:41:10.896021 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:41:10.896021 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:41:10.896021 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:41:10.896021 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:10.896021 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 192/371] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Apr 30 20:41:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:41:10.900926 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7395b-d11b-43f6-af47-8e5631004f27 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:10.921189 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 180/372] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:41:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:41:10.930220 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa853934-2f91-47f5-ac5d-35007a28fcf4 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:11.016027 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7395b-d11b-43f6-af47-8e5631004f27 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:11.053862 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e9853-1a70-461c-b1ea-ea0bf5314dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:11.054536 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e9853-1a70-461c-b1ea-ea0bf5314dcd None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:11.054821 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e9853-1a70-461c-b1ea-ea0bf5314dcd None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:11.055100 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e9853-1a70-461c-b1ea-ea0bf5314dcd None admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:11.055842 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e9853-1a70-461c-b1ea-ea0bf5314dcd None admin] RBAC: Adding query filter params (name=admin) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:11.056155 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e9853-1a70-461c-b1ea-ea0bf5314dcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:11.057583 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e9853-1a70-461c-b1ea-ea0bf5314dcd None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:11.074919 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 193/373] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:41:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:11.080395 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e9853-1a70-461c-b1ea-ea0bf5314dcd None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:11.106009 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa853934-2f91-47f5-ac5d-35007a28fcf4 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:11.154725 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b8c82-32e9-41c2-9a80-7677860eabfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:11.155648 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b8c82-32e9-41c2-9a80-7677860eabfb None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:11.155926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b8c82-32e9-41c2-9a80-7677860eabfb None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:11.156247 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b8c82-32e9-41c2-9a80-7677860eabfb None admin] PATH_INFO: `/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:11.157727 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b8c82-32e9-41c2-9a80-7677860eabfb None admin] RBAC: Authorizing `identity:get_project(project_id=5141353bfd044a1ba7fb8ba70efe9a73)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:11.163831 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b8c82-32e9-41c2-9a80-7677860eabfb None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:11.165976 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 181/374] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:41:10 2022] GET /identity/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73 => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:41:11.171514 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b8c82-32e9-41c2-9a80-7677860eabfb None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:11.273057 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e9853-1a70-461c-b1ea-ea0bf5314dcd None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:11.335779 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a343b-3684-4033-95dd-579827f43dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:11.336387 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a343b-3684-4033-95dd-579827f43dab None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:11.336668 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a343b-3684-4033-95dd-579827f43dab None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:11.336965 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a343b-3684-4033-95dd-579827f43dab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:11.354538 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b8c82-32e9-41c2-9a80-7677860eabfb None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:11.415012 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c12226-24a7-458f-908b-cddad1fdcd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:11.415872 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c12226-24a7-458f-908b-cddad1fdcd9f None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:11.416155 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c12226-24a7-458f-908b-cddad1fdcd9f None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:11.416421 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c12226-24a7-458f-908b-cddad1fdcd9f None admin] PATH_INFO: `/v3/groups/9ddd9cff0769482e8b596c8f6f6deac6` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:11.418444 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c12226-24a7-458f-908b-cddad1fdcd9f None admin] RBAC: Authorizing `identity:get_group(group_id=9ddd9cff0769482e8b596c8f6f6deac6)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:11.419936 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c12226-24a7-458f-908b-cddad1fdcd9f None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:11.421683 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 182/375] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Apr 30 20:41:11 2022] GET /identity/v3/groups/9ddd9cff0769482e8b596c8f6f6deac6 => generated 226 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:11.428697 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c12226-24a7-458f-908b-cddad1fdcd9f None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:11.462053 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a343b-3684-4033-95dd-579827f43dab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:11.463562 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a343b-3684-4033-95dd-579827f43dab None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:11.542245 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c12226-24a7-458f-908b-cddad1fdcd9f None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:11.577887 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5fddd-cf07-48f5-aa76-63b32552c273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:11.578549 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5fddd-cf07-48f5-aa76-63b32552c273 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:11.578839 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5fddd-cf07-48f5-aa76-63b32552c273 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:11.579115 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5fddd-cf07-48f5-aa76-63b32552c273 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:11.580101 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5fddd-cf07-48f5-aa76-63b32552c273 None admin] RBAC: Adding query filter params (group.id=9ddd9cff0769482e8b596c8f6f6deac6, role.id=f76bb9b1c47a4fbfa232de16b0b4a0d5, scope.project.id=5141353bfd044a1ba7fb8ba70efe9a73) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:11.580599 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5fddd-cf07-48f5-aa76-63b32552c273 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:11.582085 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5fddd-cf07-48f5-aa76-63b32552c273 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:11.588361 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 183/376] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Apr 30 20:41:11 2022] GET /identity/v3/role_assignments?group.id=9ddd9cff0769482e8b596c8f6f6deac6&scope.project.id=5141353bfd044a1ba7fb8ba70efe9a73&role.id=f76bb9b1c47a4fbfa232de16b0b4a0d5 => generated 260 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:41:11.655617 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 194/377] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:41:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:41:11.661162 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5fddd-cf07-48f5-aa76-63b32552c273 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:11.785791 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5fddd-cf07-48f5-aa76-63b32552c273 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:11.827412 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b4a34-08d1-4fa7-ac7a-39fb91dfacb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:11.828489 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b4a34-08d1-4fa7-ac7a-39fb91dfacb9 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:11.828954 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b4a34-08d1-4fa7-ac7a-39fb91dfacb9 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:11.829393 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b4a34-08d1-4fa7-ac7a-39fb91dfacb9 None admin] PATH_INFO: `/v3/projects/d7eaab61e23a485db5f1e2bf1736a9f5` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:11.831597 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b4a34-08d1-4fa7-ac7a-39fb91dfacb9 None admin] RBAC: Authorizing `identity:get_project(project_id=d7eaab61e23a485db5f1e2bf1736a9f5)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:11.833302 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b4a34-08d1-4fa7-ac7a-39fb91dfacb9 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:11.835570 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 184/378] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:41:11 2022] GET /identity/v3/projects/d7eaab61e23a485db5f1e2bf1736a9f5 => generated 344 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:11.841415 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a343b-3684-4033-95dd-579827f43dab None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:11.951225 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a343b-3684-4033-95dd-579827f43dab None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:11.996842 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86968b8b-d718-4f46-bd25-6c2b83d9d1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:11.997963 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86968b8b-d718-4f46-bd25-6c2b83d9d1c1 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:11.998410 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86968b8b-d718-4f46-bd25-6c2b83d9d1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:11.998842 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86968b8b-d718-4f46-bd25-6c2b83d9d1c1 None admin] PATH_INFO: `/v3/groups/f7205ff03574424db8b5ac5ed5bdd0c2` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:12.007361 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86968b8b-d718-4f46-bd25-6c2b83d9d1c1 None admin] RBAC: Authorizing `identity:get_group(group_id=f7205ff03574424db8b5ac5ed5bdd0c2)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:12.009064 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86968b8b-d718-4f46-bd25-6c2b83d9d1c1 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:12.010896 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 195/379] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Apr 30 20:41:11 2022] GET /identity/v3/groups/f7205ff03574424db8b5ac5ed5bdd0c2 => generated 229 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:12.016750 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b4a34-08d1-4fa7-ac7a-39fb91dfacb9 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:12.129002 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b4a34-08d1-4fa7-ac7a-39fb91dfacb9 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:12.164943 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd2f65-8ae3-4018-bb6c-bf33da9e9870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:12.165841 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd2f65-8ae3-4018-bb6c-bf33da9e9870 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:12.166267 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd2f65-8ae3-4018-bb6c-bf33da9e9870 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:12.166684 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd2f65-8ae3-4018-bb6c-bf33da9e9870 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:12.167667 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd2f65-8ae3-4018-bb6c-bf33da9e9870 None admin] RBAC: Adding query filter params (group.id=f7205ff03574424db8b5ac5ed5bdd0c2, role.id=31b3f11a82cd4cd2823e88aa0e931323, scope.project.id=d7eaab61e23a485db5f1e2bf1736a9f5) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:12.168124 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd2f65-8ae3-4018-bb6c-bf33da9e9870 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:12.169722 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd2f65-8ae3-4018-bb6c-bf33da9e9870 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:12.175975 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 185/380] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Apr 30 20:41:12 2022] GET /identity/v3/role_assignments?group.id=f7205ff03574424db8b5ac5ed5bdd0c2&scope.project.id=d7eaab61e23a485db5f1e2bf1736a9f5&role.id=31b3f11a82cd4cd2823e88aa0e931323 => generated 260 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:12.665877 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1089db-70a8-43eb-b3ac-9ffb7677f926 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:12.666764 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1089db-70a8-43eb-b3ac-9ffb7677f926 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:12.667188 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1089db-70a8-43eb-b3ac-9ffb7677f926 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:12.669011 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 196/381] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:12.677298 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5881f22-0f7e-4c2a-89f5-070dc1289b4c None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:12.678089 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5881f22-0f7e-4c2a-89f5-070dc1289b4c None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:12.678543 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5881f22-0f7e-4c2a-89f5-070dc1289b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:12.702000 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-d5881f22-0f7e-4c2a-89f5-070dc1289b4c None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:12.703193 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-d5881f22-0f7e-4c2a-89f5-070dc1289b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:12.790050 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 186/382] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:41:12.835284 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1089db-70a8-43eb-b3ac-9ffb7677f926 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:12.969670 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1089db-70a8-43eb-b3ac-9ffb7677f926 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:13.011373 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14909f15-0597-40c1-b123-3881a02c90d3 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:13.011693 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14909f15-0597-40c1-b123-3881a02c90d3 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:13.011929 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14909f15-0597-40c1-b123-3881a02c90d3 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:13.013366 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 187/383] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:13.021087 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c262f07-ca88-4a87-8a9d-4037005528c6 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:13.021554 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c262f07-ca88-4a87-8a9d-4037005528c6 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:13.021909 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c262f07-ca88-4a87-8a9d-4037005528c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:13.024735 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047ecbe-9e84-4785-8dbb-107b31757b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:13.025758 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047ecbe-9e84-4785-8dbb-107b31757b24 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:13.026213 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047ecbe-9e84-4785-8dbb-107b31757b24 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:13.026650 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047ecbe-9e84-4785-8dbb-107b31757b24 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:13.041405 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047ecbe-9e84-4785-8dbb-107b31757b24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:41:13.042650 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-8c262f07-ca88-4a87-8a9d-4037005528c6 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:13.043968 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-8c262f07-ca88-4a87-8a9d-4037005528c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:13.050305 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-5047ecbe-9e84-4785-8dbb-107b31757b24 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:41:13.050305 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:13.050305 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:13.050305 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:13.050305 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:13.050305 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:13.050305 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:13.050305 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:13.050305 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:13.050305 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:13.050305 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:13.050305 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:13.050305 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:41:13.050305 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:41:13.050305 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:41:13.050305 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:41:13.051192 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:41:13.051192 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:41:13.051192 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:41:13.051192 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:41:13.051192 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:13.051192 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:13.051192 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:13.051192 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:13.051192 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:13.051192 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:13.051192 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:13.051192 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:13.051192 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:13.051192 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:13.051192 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:13.051192 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:13.052051 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:13.052051 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:13.052051 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:13.052051 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:13.052051 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:41:13.052051 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:41:13.052051 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:41:13.052051 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:41:13.052051 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:41:13.052051 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:41:13.052051 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:41:13.052051 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:13.054583 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 197/384] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:41:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:13.061533 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047ecbe-9e84-4785-8dbb-107b31757b24 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:13.126663 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 188/385] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:41:13.160100 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c262f07-ca88-4a87-8a9d-4037005528c6 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:13.184035 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047ecbe-9e84-4785-8dbb-107b31757b24 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:13.225555 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722624ae-0c7a-4872-ae4a-ee8a0829b781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:13.226807 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722624ae-0c7a-4872-ae4a-ee8a0829b781 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:13.227322 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722624ae-0c7a-4872-ae4a-ee8a0829b781 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:13.227804 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722624ae-0c7a-4872-ae4a-ee8a0829b781 None admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:13.228732 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722624ae-0c7a-4872-ae4a-ee8a0829b781 None admin] RBAC: Adding query filter params (name=member) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:13.229763 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722624ae-0c7a-4872-ae4a-ee8a0829b781 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:13.231367 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722624ae-0c7a-4872-ae4a-ee8a0829b781 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:13.240705 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 198/386] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Apr 30 20:41:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:13.246629 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722624ae-0c7a-4872-ae4a-ee8a0829b781 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:13.284033 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c262f07-ca88-4a87-8a9d-4037005528c6 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:13.332787 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd065ad-1312-41cf-8d25-88aa1e636aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:13.333831 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd065ad-1312-41cf-8d25-88aa1e636aa2 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:13.334118 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd065ad-1312-41cf-8d25-88aa1e636aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:13.334393 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd065ad-1312-41cf-8d25-88aa1e636aa2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:13.353437 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd065ad-1312-41cf-8d25-88aa1e636aa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:41:13.364596 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-7bd065ad-1312-41cf-8d25-88aa1e636aa2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:41:13.364596 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:13.364596 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:13.364596 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:13.364596 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:13.364596 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:13.364596 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:13.364596 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:13.364596 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:13.364596 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:13.364596 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:13.364596 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:13.364596 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:41:13.364596 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:41:13.364596 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:41:13.364596 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:41:13.365599 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:41:13.365599 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:41:13.365599 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:41:13.365599 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:41:13.365599 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:13.365599 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:13.365599 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:13.365599 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:13.365599 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:13.365599 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:13.365599 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:13.365599 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:13.365599 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:13.365599 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:13.365599 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:13.365599 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:13.366389 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:13.366389 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:13.366389 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:13.366389 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:13.366389 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:41:13.366389 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:41:13.366389 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:41:13.366389 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:41:13.366389 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:41:13.366389 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:41:13.366389 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:41:13.366389 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:13.371897 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 189/387] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Apr 30 20:41:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:41:13.379304 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd065ad-1312-41cf-8d25-88aa1e636aa2 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:13.386399 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722624ae-0c7a-4872-ae4a-ee8a0829b781 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:13.431314 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3892fe-5a39-48a8-93ab-19519478059f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:13.433002 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3892fe-5a39-48a8-93ab-19519478059f None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:13.433464 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3892fe-5a39-48a8-93ab-19519478059f None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:13.433925 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3892fe-5a39-48a8-93ab-19519478059f None admin] PATH_INFO: `/v3/groups/9ddd9cff0769482e8b596c8f6f6deac6` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:13.435983 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3892fe-5a39-48a8-93ab-19519478059f None admin] RBAC: Authorizing `identity:get_group(group_id=9ddd9cff0769482e8b596c8f6f6deac6)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:13.437997 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3892fe-5a39-48a8-93ab-19519478059f None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:13.440999 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 199/388] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Apr 30 20:41:13 2022] GET /identity/v3/groups/9ddd9cff0769482e8b596c8f6f6deac6 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:41:13.446576 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3892fe-5a39-48a8-93ab-19519478059f None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:13.511704 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd065ad-1312-41cf-8d25-88aa1e636aa2 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:13.556943 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d039f-751c-4f21-bfb6-b781f1188dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:13.556943 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d039f-751c-4f21-bfb6-b781f1188dfa None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:13.557203 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d039f-751c-4f21-bfb6-b781f1188dfa None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:13.557464 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d039f-751c-4f21-bfb6-b781f1188dfa None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:13.558212 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d039f-751c-4f21-bfb6-b781f1188dfa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:13.558689 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d039f-751c-4f21-bfb6-b781f1188dfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:13.560116 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d039f-751c-4f21-bfb6-b781f1188dfa None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:13.571799 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 190/389] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:41:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:13.572182 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3892fe-5a39-48a8-93ab-19519478059f None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:13.573206 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131cc3e-18bd-434e-83a7-581e4487de8c None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:13.573494 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131cc3e-18bd-434e-83a7-581e4487de8c None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:13.573766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131cc3e-18bd-434e-83a7-581e4487de8c None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:13.575968 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 191/390] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:13.578120 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131cc3e-18bd-434e-83a7-581e4487de8c None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:13.609206 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860dc1fb-761f-42e9-bb06-f661552d0300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:13.610577 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860dc1fb-761f-42e9-bb06-f661552d0300 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:13.611109 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860dc1fb-761f-42e9-bb06-f661552d0300 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:13.611622 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860dc1fb-761f-42e9-bb06-f661552d0300 None admin] PATH_INFO: `/v3/projects/b65984e2c7ae400c829003b7ab39d8e2` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:13.613060 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860dc1fb-761f-42e9-bb06-f661552d0300 None admin] RBAC: Authorizing `identity:get_project(project_id=b65984e2c7ae400c829003b7ab39d8e2)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:13.614840 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860dc1fb-761f-42e9-bb06-f661552d0300 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:13.617443 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 200/391] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:41:13 2022] GET /identity/v3/projects/b65984e2c7ae400c829003b7ab39d8e2 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:41:13.618907 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bfae1-cad6-4753-8c28-b4d4133ec276 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:13.619446 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bfae1-cad6-4753-8c28-b4d4133ec276 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:13.619911 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bfae1-cad6-4753-8c28-b4d4133ec276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:13.643899 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-667bfae1-cad6-4753-8c28-b4d4133ec276 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:13.645548 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-667bfae1-cad6-4753-8c28-b4d4133ec276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:13.690553 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131cc3e-18bd-434e-83a7-581e4487de8c None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:13.717241 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 201/392] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:41:13.718885 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bfae1-cad6-4753-8c28-b4d4133ec276 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:13.726397 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf881f8-03de-46f8-8bc6-51f3d92e75bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:13.727258 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf881f8-03de-46f8-8bc6-51f3d92e75bc None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:13.727535 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf881f8-03de-46f8-8bc6-51f3d92e75bc None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:13.727805 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf881f8-03de-46f8-8bc6-51f3d92e75bc None admin] PATH_INFO: `/v3/groups/9ddd9cff0769482e8b596c8f6f6deac6` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:13.729005 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf881f8-03de-46f8-8bc6-51f3d92e75bc None admin] RBAC: Authorizing `identity:get_group(group_id=9ddd9cff0769482e8b596c8f6f6deac6)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:13.730504 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf881f8-03de-46f8-8bc6-51f3d92e75bc None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:13.732290 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 192/393] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Apr 30 20:41:13 2022] GET /identity/v3/groups/9ddd9cff0769482e8b596c8f6f6deac6 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:41:13.737844 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf881f8-03de-46f8-8bc6-51f3d92e75bc None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:13.828892 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bfae1-cad6-4753-8c28-b4d4133ec276 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:13.848539 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf881f8-03de-46f8-8bc6-51f3d92e75bc None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:13.864883 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc22bad-20fe-457a-9db3-d4a589742aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:13.866123 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc22bad-20fe-457a-9db3-d4a589742aed None admin] REQUEST_METHOD: `PUT` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:13.866596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc22bad-20fe-457a-9db3-d4a589742aed None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:13.867060 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc22bad-20fe-457a-9db3-d4a589742aed None admin] PATH_INFO: `/v3/projects/b65984e2c7ae400c829003b7ab39d8e2/groups/9ddd9cff0769482e8b596c8f6f6deac6/roles/375abc9f701c408ea332eaf2d8a2e086` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:13.869287 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc22bad-20fe-457a-9db3-d4a589742aed None admin] RBAC: Authorizing `identity:create_grant(project_id=b65984e2c7ae400c829003b7ab39d8e2, group_id=9ddd9cff0769482e8b596c8f6f6deac6, role_id=375abc9f701c408ea332eaf2d8a2e086)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:13.870932 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc22bad-20fe-457a-9db3-d4a589742aed None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:13.886662 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84011f2-5040-4a40-b219-2bcf3ce763de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:13.886972 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84011f2-5040-4a40-b219-2bcf3ce763de None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:13.887242 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84011f2-5040-4a40-b219-2bcf3ce763de None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:13.887519 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84011f2-5040-4a40-b219-2bcf3ce763de None admin] PATH_INFO: `/v3/projects/b65984e2c7ae400c829003b7ab39d8e2` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:13.888706 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84011f2-5040-4a40-b219-2bcf3ce763de None admin] RBAC: Authorizing `identity:get_project(project_id=b65984e2c7ae400c829003b7ab39d8e2)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:13.890226 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84011f2-5040-4a40-b219-2bcf3ce763de None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:13.892980 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 193/394] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:41:13 2022] GET /identity/v3/projects/b65984e2c7ae400c829003b7ab39d8e2 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:13.893974 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84011f2-5040-4a40-b219-2bcf3ce763de None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:13.976361 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 202/395] 10.222.0.26 () {58 vars in 1442 bytes} [Sat Apr 30 20:41:13 2022] PUT /identity/v3/projects/b65984e2c7ae400c829003b7ab39d8e2/groups/9ddd9cff0769482e8b596c8f6f6deac6/roles/375abc9f701c408ea332eaf2d8a2e086 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:41:13.977285 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc22bad-20fe-457a-9db3-d4a589742aed None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:14.007100 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84011f2-5040-4a40-b219-2bcf3ce763de None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:14.051470 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501aff72-da36-433a-8ef0-87d0f79423ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:14.052630 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501aff72-da36-433a-8ef0-87d0f79423ae None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:14.053159 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501aff72-da36-433a-8ef0-87d0f79423ae None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:14.053628 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501aff72-da36-433a-8ef0-87d0f79423ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:14.067512 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501aff72-da36-433a-8ef0-87d0f79423ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:41:14.077026 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-501aff72-da36-433a-8ef0-87d0f79423ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:41:14.077026 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:14.077026 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:14.077026 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:14.077026 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:14.077026 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:14.077026 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:14.077026 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:14.077026 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:14.077026 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:14.077026 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:14.077026 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:14.077026 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:41:14.077026 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:41:14.077026 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:41:14.077026 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:41:14.077927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:41:14.077927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:41:14.077927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:41:14.077927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:41:14.077927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:14.077927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:14.077927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:14.077927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:14.077927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:14.077927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:14.077927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:14.077927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:14.077927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:14.077927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:14.077927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:14.077927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:14.078700 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:14.078700 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:14.078700 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:14.078700 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:14.078700 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:41:14.078700 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:41:14.078700 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:41:14.078700 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:41:14.078700 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:41:14.078700 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:41:14.078700 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:41:14.078700 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:14.082420 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 194/396] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:41:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:14.088395 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501aff72-da36-433a-8ef0-87d0f79423ae None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:14.199195 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc22bad-20fe-457a-9db3-d4a589742aed None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:14.208985 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501aff72-da36-433a-8ef0-87d0f79423ae None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:14.248161 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f3e37-6725-40e0-a879-e4de8f4bdc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:14.249413 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f3e37-6725-40e0-a879-e4de8f4bdc85 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:14.249900 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f3e37-6725-40e0-a879-e4de8f4bdc85 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:14.250377 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f3e37-6725-40e0-a879-e4de8f4bdc85 None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:14.251475 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f3e37-6725-40e0-a879-e4de8f4bdc85 None admin] RBAC: Adding query filter params (name=member) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:14.252505 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f3e37-6725-40e0-a879-e4de8f4bdc85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:14.254743 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f3e37-6725-40e0-a879-e4de8f4bdc85 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:14.265003 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 195/397] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Apr 30 20:41:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:14.271369 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f3e37-6725-40e0-a879-e4de8f4bdc85 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:14.283546 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032f69f-6fbf-44c2-9fec-1133ec450654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:14.284634 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032f69f-6fbf-44c2-9fec-1133ec450654 None admin] REQUEST_METHOD: `PUT` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:14.284937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032f69f-6fbf-44c2-9fec-1133ec450654 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:14.285212 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032f69f-6fbf-44c2-9fec-1133ec450654 None admin] PATH_INFO: `/v3/projects/b65984e2c7ae400c829003b7ab39d8e2/groups/9ddd9cff0769482e8b596c8f6f6deac6/roles/f76bb9b1c47a4fbfa232de16b0b4a0d5` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:14.293873 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032f69f-6fbf-44c2-9fec-1133ec450654 None admin] RBAC: Authorizing `identity:create_grant(project_id=b65984e2c7ae400c829003b7ab39d8e2, group_id=9ddd9cff0769482e8b596c8f6f6deac6, role_id=f76bb9b1c47a4fbfa232de16b0b4a0d5)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:14.295306 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032f69f-6fbf-44c2-9fec-1133ec450654 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:14.362224 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 203/398] 10.222.0.26 () {58 vars in 1442 bytes} [Sat Apr 30 20:41:13 2022] PUT /identity/v3/projects/b65984e2c7ae400c829003b7ab39d8e2/groups/9ddd9cff0769482e8b596c8f6f6deac6/roles/f76bb9b1c47a4fbfa232de16b0b4a0d5 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:41:14.393070 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f3e37-6725-40e0-a879-e4de8f4bdc85 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:14.431411 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7677b18-e1a7-426c-9a47-1bda1b424c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:14.432650 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7677b18-e1a7-426c-9a47-1bda1b424c81 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:14.433160 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7677b18-e1a7-426c-9a47-1bda1b424c81 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:14.433657 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7677b18-e1a7-426c-9a47-1bda1b424c81 None admin] PATH_INFO: `/v3/groups/9ddd9cff0769482e8b596c8f6f6deac6` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:14.435117 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7677b18-e1a7-426c-9a47-1bda1b424c81 None admin] RBAC: Authorizing `identity:get_group(group_id=9ddd9cff0769482e8b596c8f6f6deac6)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:14.436963 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7677b18-e1a7-426c-9a47-1bda1b424c81 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:14.439281 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 196/399] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Apr 30 20:41:14 2022] GET /identity/v3/groups/9ddd9cff0769482e8b596c8f6f6deac6 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:14.444896 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032f69f-6fbf-44c2-9fec-1133ec450654 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:14.567478 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032f69f-6fbf-44c2-9fec-1133ec450654 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:14.609609 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802c559-ea3a-4174-8d82-64247a0182a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:14.610834 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802c559-ea3a-4174-8d82-64247a0182a3 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:14.611825 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802c559-ea3a-4174-8d82-64247a0182a3 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:14.612344 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802c559-ea3a-4174-8d82-64247a0182a3 None admin] PATH_INFO: `/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:14.614790 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802c559-ea3a-4174-8d82-64247a0182a3 None admin] RBAC: Authorizing `identity:get_project(project_id=5141353bfd044a1ba7fb8ba70efe9a73)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:14.616531 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802c559-ea3a-4174-8d82-64247a0182a3 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:14.618780 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 204/400] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:41:14 2022] GET /identity/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:14.624120 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7677b18-e1a7-426c-9a47-1bda1b424c81 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:14.733796 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7677b18-e1a7-426c-9a47-1bda1b424c81 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:14.769778 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c2f53-bbd8-4748-b306-a5e36d4b8625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:14.770996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c2f53-bbd8-4748-b306-a5e36d4b8625 None admin] REQUEST_METHOD: `PUT` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:14.771471 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c2f53-bbd8-4748-b306-a5e36d4b8625 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:14.771962 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c2f53-bbd8-4748-b306-a5e36d4b8625 None admin] PATH_INFO: `/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73/groups/9ddd9cff0769482e8b596c8f6f6deac6/roles/375abc9f701c408ea332eaf2d8a2e086` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:14.774129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c2f53-bbd8-4748-b306-a5e36d4b8625 None admin] RBAC: Authorizing `identity:create_grant(project_id=5141353bfd044a1ba7fb8ba70efe9a73, group_id=9ddd9cff0769482e8b596c8f6f6deac6, role_id=375abc9f701c408ea332eaf2d8a2e086)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:14.775854 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c2f53-bbd8-4748-b306-a5e36d4b8625 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:14.874202 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 197/401] 10.222.0.26 () {58 vars in 1442 bytes} [Sat Apr 30 20:41:14 2022] PUT /identity/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73/groups/9ddd9cff0769482e8b596c8f6f6deac6/roles/375abc9f701c408ea332eaf2d8a2e086 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 20:41:15.049530 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed964f-b991-4449-9ef5-5e7dd53386e8 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:15.050631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed964f-b991-4449-9ef5-5e7dd53386e8 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:15.051143 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed964f-b991-4449-9ef5-5e7dd53386e8 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:15.053090 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 205/402] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:15.058652 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13f759-fdce-4437-835e-3fc990b13e63 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:15.059235 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13f759-fdce-4437-835e-3fc990b13e63 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:15.059710 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13f759-fdce-4437-835e-3fc990b13e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:15.083602 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-4a13f759-fdce-4437-835e-3fc990b13e63 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:15.085239 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-4a13f759-fdce-4437-835e-3fc990b13e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:15.128693 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf151b0-7487-47e5-ba03-cc7c29d88e26 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:15.129001 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf151b0-7487-47e5-ba03-cc7c29d88e26 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:15.129217 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf151b0-7487-47e5-ba03-cc7c29d88e26 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:15.131987 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 206/403] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:15.137088 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a59a8-da44-4ba8-a949-c9243ec0abeb None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:15.137420 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a59a8-da44-4ba8-a949-c9243ec0abeb None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:15.137702 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a59a8-da44-4ba8-a949-c9243ec0abeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:15.155108 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-da6a59a8-da44-4ba8-a949-c9243ec0abeb None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:15.156282 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-da6a59a8-da44-4ba8-a949-c9243ec0abeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:15.163028 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 198/404] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:41:15.198419 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13f759-fdce-4437-835e-3fc990b13e63 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:15.257854 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 207/405] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:41:15.298448 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a59a8-da44-4ba8-a949-c9243ec0abeb None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:15.337550 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13f759-fdce-4437-835e-3fc990b13e63 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:15.389691 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b78e2b-5737-477c-a28b-fbf5b9c1f993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:15.390438 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b78e2b-5737-477c-a28b-fbf5b9c1f993 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:15.390718 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b78e2b-5737-477c-a28b-fbf5b9c1f993 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:15.391002 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b78e2b-5737-477c-a28b-fbf5b9c1f993 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:15.412494 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b78e2b-5737-477c-a28b-fbf5b9c1f993 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:41:15.420601 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-61b78e2b-5737-477c-a28b-fbf5b9c1f993 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:41:15.420601 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:15.420601 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:15.420601 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:15.420601 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:15.420601 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:15.420601 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:15.420601 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:15.420601 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:15.420601 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:15.420601 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:15.420601 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:15.420601 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:41:15.420601 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:41:15.420601 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:41:15.420601 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:41:15.421528 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:41:15.421528 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:41:15.421528 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:41:15.421528 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:41:15.421528 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:15.421528 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:15.421528 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:15.421528 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:15.421528 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:15.421528 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:15.421528 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:15.421528 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:15.421528 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:15.421528 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:15.421528 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:15.421528 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:15.422391 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:15.422391 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:15.422391 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:15.422391 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:15.422391 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:41:15.422391 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:41:15.422391 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:41:15.422391 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:41:15.422391 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:41:15.422391 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:41:15.422391 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:41:15.422391 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:15.422391 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 199/406] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Apr 30 20:41:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:41:15.427771 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b78e2b-5737-477c-a28b-fbf5b9c1f993 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:15.468568 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a59a8-da44-4ba8-a949-c9243ec0abeb None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:15.513055 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e6b36-8921-4938-b037-3e6352a20a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:15.514237 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e6b36-8921-4938-b037-3e6352a20a02 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:15.514714 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e6b36-8921-4938-b037-3e6352a20a02 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:15.515222 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e6b36-8921-4938-b037-3e6352a20a02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:15.529805 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e6b36-8921-4938-b037-3e6352a20a02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:41:15.538519 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-e42e6b36-8921-4938-b037-3e6352a20a02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:41:15.538519 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:15.538519 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:15.538519 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:15.538519 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:15.538519 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:15.538519 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:15.538519 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:15.538519 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:15.538519 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:15.538519 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:15.538519 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:15.538519 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:41:15.538519 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:41:15.538519 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:41:15.538519 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:41:15.539427 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:41:15.539427 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:41:15.539427 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:41:15.539427 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:41:15.539427 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:15.539427 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:15.539427 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:15.539427 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:15.539427 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:15.539427 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:15.539427 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:15.539427 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:15.539427 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:15.539427 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:15.539427 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:15.539427 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:15.540627 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:15.540627 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:15.540627 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:15.540627 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:15.540627 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:41:15.540627 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:41:15.540627 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:41:15.540627 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:41:15.540627 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:41:15.540627 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:41:15.540627 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:41:15.540627 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:15.540627 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 208/407] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Apr 30 20:41:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:41:15.546442 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e6b36-8921-4938-b037-3e6352a20a02 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:15.548410 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b78e2b-5737-477c-a28b-fbf5b9c1f993 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:15.631084 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20ddf7-5167-415d-9a1b-1e2c5b977b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:15.631769 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20ddf7-5167-415d-9a1b-1e2c5b977b89 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:15.632055 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20ddf7-5167-415d-9a1b-1e2c5b977b89 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:15.632334 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20ddf7-5167-415d-9a1b-1e2c5b977b89 None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:15.636109 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20ddf7-5167-415d-9a1b-1e2c5b977b89 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:15.636109 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20ddf7-5167-415d-9a1b-1e2c5b977b89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:15.636109 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20ddf7-5167-415d-9a1b-1e2c5b977b89 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:15.650570 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 200/408] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:41:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:15.656003 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20ddf7-5167-415d-9a1b-1e2c5b977b89 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:15.675693 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e6b36-8921-4938-b037-3e6352a20a02 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:15.714076 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe2f0a-acb4-41f9-8323-fea1975fd00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:15.714747 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe2f0a-acb4-41f9-8323-fea1975fd00a None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:15.715028 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe2f0a-acb4-41f9-8323-fea1975fd00a None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:15.715292 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe2f0a-acb4-41f9-8323-fea1975fd00a None admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:15.716029 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe2f0a-acb4-41f9-8323-fea1975fd00a None admin] RBAC: Adding query filter params (name=admin) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:15.716335 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe2f0a-acb4-41f9-8323-fea1975fd00a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:15.717753 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe2f0a-acb4-41f9-8323-fea1975fd00a None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:15.736129 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 209/409] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:41:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:15.743136 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe2f0a-acb4-41f9-8323-fea1975fd00a None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:15.856623 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20ddf7-5167-415d-9a1b-1e2c5b977b89 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:15.916532 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe2f0a-acb4-41f9-8323-fea1975fd00a None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:15.920788 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c539e-abc2-46cc-a419-f90a5451f175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:15.921679 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c539e-abc2-46cc-a419-f90a5451f175 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:15.921959 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c539e-abc2-46cc-a419-f90a5451f175 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:15.922234 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c539e-abc2-46cc-a419-f90a5451f175 None admin] PATH_INFO: `/v3/groups/9ddd9cff0769482e8b596c8f6f6deac6` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:15.927629 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c539e-abc2-46cc-a419-f90a5451f175 None admin] RBAC: Authorizing `identity:get_group(group_id=9ddd9cff0769482e8b596c8f6f6deac6)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:15.929120 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c539e-abc2-46cc-a419-f90a5451f175 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:15.930772 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 201/410] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Apr 30 20:41:15 2022] GET /identity/v3/groups/9ddd9cff0769482e8b596c8f6f6deac6 => generated 226 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:41:15.937173 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c539e-abc2-46cc-a419-f90a5451f175 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:15.985421 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775055c-cc9b-41e8-8d42-8a73a5b28551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:15.986379 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775055c-cc9b-41e8-8d42-8a73a5b28551 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:15.986643 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775055c-cc9b-41e8-8d42-8a73a5b28551 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:15.986917 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775055c-cc9b-41e8-8d42-8a73a5b28551 None admin] PATH_INFO: `/v3/groups/f7205ff03574424db8b5ac5ed5bdd0c2` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:15.988741 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3775055c-cc9b-41e8-8d42-8a73a5b28551 None admin] RBAC: Authorizing `identity:get_group(group_id=f7205ff03574424db8b5ac5ed5bdd0c2)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:15.990225 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3775055c-cc9b-41e8-8d42-8a73a5b28551 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:15.991845 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 210/411] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Apr 30 20:41:15 2022] GET /identity/v3/groups/f7205ff03574424db8b5ac5ed5bdd0c2 => generated 229 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:41:15.998670 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775055c-cc9b-41e8-8d42-8a73a5b28551 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:16.126380 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c539e-abc2-46cc-a419-f90a5451f175 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:16.166669 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775055c-cc9b-41e8-8d42-8a73a5b28551 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:16.200168 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938dc698-8d2c-41a4-82e2-430cdc646931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:16.201066 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938dc698-8d2c-41a4-82e2-430cdc646931 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:16.201348 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938dc698-8d2c-41a4-82e2-430cdc646931 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:16.201621 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938dc698-8d2c-41a4-82e2-430cdc646931 None admin] PATH_INFO: `/v3/projects/d7eaab61e23a485db5f1e2bf1736a9f5` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:16.202810 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938dc698-8d2c-41a4-82e2-430cdc646931 None admin] RBAC: Authorizing `identity:get_project(project_id=d7eaab61e23a485db5f1e2bf1736a9f5)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:16.204257 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938dc698-8d2c-41a4-82e2-430cdc646931 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:16.207025 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 211/412] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:41:15 2022] GET /identity/v3/projects/d7eaab61e23a485db5f1e2bf1736a9f5 => generated 344 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:16.207520 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dfc1e8-efe2-4bcd-92cd-8e6490cf8ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:16.208390 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfc1e8-efe2-4bcd-92cd-8e6490cf8ec5 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:16.208671 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfc1e8-efe2-4bcd-92cd-8e6490cf8ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:16.212941 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfc1e8-efe2-4bcd-92cd-8e6490cf8ec5 None admin] PATH_INFO: `/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:16.212941 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dfc1e8-efe2-4bcd-92cd-8e6490cf8ec5 None admin] RBAC: Authorizing `identity:get_project(project_id=5141353bfd044a1ba7fb8ba70efe9a73)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:16.212941 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dfc1e8-efe2-4bcd-92cd-8e6490cf8ec5 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:16.213499 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 202/413] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:41:15 2022] GET /identity/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73 => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:41:16.214288 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938dc698-8d2c-41a4-82e2-430cdc646931 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:16.221253 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dfc1e8-efe2-4bcd-92cd-8e6490cf8ec5 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:16.386299 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938dc698-8d2c-41a4-82e2-430cdc646931 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:16.390959 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dfc1e8-efe2-4bcd-92cd-8e6490cf8ec5 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:16.438589 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82706ad7-3af2-4058-87f5-85988f046554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:16.439597 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82706ad7-3af2-4058-87f5-85988f046554 None admin] REQUEST_METHOD: `PUT` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:16.439879 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82706ad7-3af2-4058-87f5-85988f046554 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:16.440151 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82706ad7-3af2-4058-87f5-85988f046554 None admin] PATH_INFO: `/v3/projects/d7eaab61e23a485db5f1e2bf1736a9f5/groups/f7205ff03574424db8b5ac5ed5bdd0c2/roles/31b3f11a82cd4cd2823e88aa0e931323` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:16.443777 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82706ad7-3af2-4058-87f5-85988f046554 None admin] RBAC: Authorizing `identity:create_grant(project_id=d7eaab61e23a485db5f1e2bf1736a9f5, group_id=f7205ff03574424db8b5ac5ed5bdd0c2, role_id=31b3f11a82cd4cd2823e88aa0e931323)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:16.445247 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82706ad7-3af2-4058-87f5-85988f046554 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:16.455555 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c61ea-ce3b-4424-a79c-e3447dbaaa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:16.456440 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c61ea-ce3b-4424-a79c-e3447dbaaa1c None admin] REQUEST_METHOD: `PUT` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:16.456717 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c61ea-ce3b-4424-a79c-e3447dbaaa1c None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:16.457021 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c61ea-ce3b-4424-a79c-e3447dbaaa1c None admin] PATH_INFO: `/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73/groups/9ddd9cff0769482e8b596c8f6f6deac6/roles/f76bb9b1c47a4fbfa232de16b0b4a0d5` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:16.459231 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c61ea-ce3b-4424-a79c-e3447dbaaa1c None admin] RBAC: Authorizing `identity:create_grant(project_id=5141353bfd044a1ba7fb8ba70efe9a73, group_id=9ddd9cff0769482e8b596c8f6f6deac6, role_id=f76bb9b1c47a4fbfa232de16b0b4a0d5)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:16.460659 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c61ea-ce3b-4424-a79c-e3447dbaaa1c None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:16.520448 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 212/414] 10.222.0.26 () {58 vars in 1442 bytes} [Sat Apr 30 20:41:16 2022] PUT /identity/v3/projects/d7eaab61e23a485db5f1e2bf1736a9f5/groups/f7205ff03574424db8b5ac5ed5bdd0c2/roles/31b3f11a82cd4cd2823e88aa0e931323 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:41:16.549147 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 203/415] 10.222.0.26 () {58 vars in 1442 bytes} [Sat Apr 30 20:41:16 2022] PUT /identity/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73/groups/9ddd9cff0769482e8b596c8f6f6deac6/roles/f76bb9b1c47a4fbfa232de16b0b4a0d5 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:41:17.129628 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b81de-d37e-40d1-a366-12f5788ed182 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:17.129979 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b81de-d37e-40d1-a366-12f5788ed182 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:17.130097 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b81de-d37e-40d1-a366-12f5788ed182 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:17.131794 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 213/416] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:17.136835 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0058b-eb9d-4251-ba66-fafd4dd6bef8 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:17.137314 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0058b-eb9d-4251-ba66-fafd4dd6bef8 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:17.137482 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0058b-eb9d-4251-ba66-fafd4dd6bef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:17.156799 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-3ec0058b-eb9d-4251-ba66-fafd4dd6bef8 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:17.158517 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-3ec0058b-eb9d-4251-ba66-fafd4dd6bef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:17.251377 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 204/417] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:41:17.298385 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b81de-d37e-40d1-a366-12f5788ed182 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:17.415970 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b81de-d37e-40d1-a366-12f5788ed182 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:17.434205 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80d3e7-d35b-4be5-b7e4-5ba36e0f9664 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:17.434483 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80d3e7-d35b-4be5-b7e4-5ba36e0f9664 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:17.434751 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80d3e7-d35b-4be5-b7e4-5ba36e0f9664 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:17.436361 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 205/418] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:17.441395 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857affcf-38f0-4f81-bbb5-a724eb771a8b None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:17.441681 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857affcf-38f0-4f81-bbb5-a724eb771a8b None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:17.441960 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857affcf-38f0-4f81-bbb5-a724eb771a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:17.454027 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755c9e7-c45a-4f42-9a8d-2c77cf9b89a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:17.454854 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755c9e7-c45a-4f42-9a8d-2c77cf9b89a4 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:17.455133 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755c9e7-c45a-4f42-9a8d-2c77cf9b89a4 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:17.455404 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755c9e7-c45a-4f42-9a8d-2c77cf9b89a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:17.475417 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755c9e7-c45a-4f42-9a8d-2c77cf9b89a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:41:17.478657 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-857affcf-38f0-4f81-bbb5-a724eb771a8b None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:17.479824 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-857affcf-38f0-4f81-bbb5-a724eb771a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:17.486788 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-b755c9e7-c45a-4f42-9a8d-2c77cf9b89a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:41:17.486788 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:17.486788 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:17.486788 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:17.486788 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:17.486788 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:17.486788 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:17.486788 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:17.486788 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:17.486788 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:17.486788 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:17.486788 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:17.486788 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:41:17.486788 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:41:17.486788 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:41:17.486788 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:41:17.488828 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:41:17.488828 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:41:17.488828 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:41:17.488828 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:41:17.488828 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:17.488828 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:17.488828 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:17.488828 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:17.488828 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:17.488828 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:17.488828 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:17.488828 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:17.488828 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:17.488828 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:17.488828 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:17.488828 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:17.496005 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:17.496005 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:17.496005 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:17.496005 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:17.496005 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:41:17.496005 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:41:17.496005 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:41:17.496005 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:41:17.496005 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:41:17.496005 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:41:17.496005 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:41:17.496005 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:17.496005 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 214/419] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:41:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:17.496005 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755c9e7-c45a-4f42-9a8d-2c77cf9b89a4 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:17.620763 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 206/420] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:41:17.640918 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755c9e7-c45a-4f42-9a8d-2c77cf9b89a4 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:17.656187 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857affcf-38f0-4f81-bbb5-a724eb771a8b None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:17.678800 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9d7a5-102a-4c15-8099-f84830cb8285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:17.679394 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9d7a5-102a-4c15-8099-f84830cb8285 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:17.679677 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9d7a5-102a-4c15-8099-f84830cb8285 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:17.679956 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9d7a5-102a-4c15-8099-f84830cb8285 None admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:17.680691 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be9d7a5-102a-4c15-8099-f84830cb8285 None admin] RBAC: Adding query filter params (name=member) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:17.681021 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be9d7a5-102a-4c15-8099-f84830cb8285 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:17.686023 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be9d7a5-102a-4c15-8099-f84830cb8285 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:17.701805 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 215/421] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Apr 30 20:41:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:41:17.709872 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9d7a5-102a-4c15-8099-f84830cb8285 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:17.792804 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857affcf-38f0-4f81-bbb5-a724eb771a8b None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:17.846681 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa32e3-9d59-4f8d-9f24-79a1b5c41c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:17.847612 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa32e3-9d59-4f8d-9f24-79a1b5c41c3c None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:17.847900 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa32e3-9d59-4f8d-9f24-79a1b5c41c3c None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:17.848176 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa32e3-9d59-4f8d-9f24-79a1b5c41c3c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:17.848384 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9d7a5-102a-4c15-8099-f84830cb8285 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:17.863003 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa32e3-9d59-4f8d-9f24-79a1b5c41c3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:41:17.871139 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-b0aa32e3-9d59-4f8d-9f24-79a1b5c41c3c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:41:17.871139 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:17.871139 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:17.871139 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:17.871139 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:17.871139 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:17.871139 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:17.871139 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:17.871139 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:17.871139 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:17.871139 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:17.871139 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:17.871139 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:41:17.871139 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:41:17.871139 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:41:17.871139 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:41:17.872032 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:41:17.872032 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:41:17.872032 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:41:17.872032 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:41:17.872032 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:17.872032 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:17.872032 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:17.872032 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:17.872032 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:17.872032 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:17.872032 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:17.872032 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:17.872032 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:17.872032 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:17.872032 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:17.872032 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:17.873559 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:17.873559 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:17.873559 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:17.873559 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:17.873559 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:41:17.873559 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:41:17.873559 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:41:17.873559 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:41:17.873559 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:41:17.873559 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:41:17.873559 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:41:17.873559 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:17.873559 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 207/422] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Apr 30 20:41:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:41:17.874227 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f0b70-b215-4fc4-84db-9dde9ed39ec0 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:17.874291 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f0b70-b215-4fc4-84db-9dde9ed39ec0 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:17.875983 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f0b70-b215-4fc4-84db-9dde9ed39ec0 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:17.875983 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 208/423] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:17.881233 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f0b70-b215-4fc4-84db-9dde9ed39ec0 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:17.888543 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb5df6-cfbc-40ba-943e-309fa0d02d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:17.889275 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb5df6-cfbc-40ba-943e-309fa0d02d7c None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:17.889565 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb5df6-cfbc-40ba-943e-309fa0d02d7c None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:17.889843 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb5df6-cfbc-40ba-943e-309fa0d02d7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:17.974605 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb5df6-cfbc-40ba-943e-309fa0d02d7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:17.977036 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb5df6-cfbc-40ba-943e-309fa0d02d7c None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:17.989335 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f0b70-b215-4fc4-84db-9dde9ed39ec0 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:18.027151 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c81d67-053c-4035-99bd-7f099d6cac5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:18.027978 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c81d67-053c-4035-99bd-7f099d6cac5b None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:18.028620 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c81d67-053c-4035-99bd-7f099d6cac5b None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:18.028923 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c81d67-053c-4035-99bd-7f099d6cac5b None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:18.029936 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c81d67-053c-4035-99bd-7f099d6cac5b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:18.030246 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c81d67-053c-4035-99bd-7f099d6cac5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:18.032094 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c81d67-053c-4035-99bd-7f099d6cac5b None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:18.043301 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 209/424] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:41:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:18.045260 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e8518-9903-4325-a5fb-88d1f5865774 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:18.045549 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e8518-9903-4325-a5fb-88d1f5865774 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:18.045822 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e8518-9903-4325-a5fb-88d1f5865774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:18.066472 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-532e8518-9903-4325-a5fb-88d1f5865774 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:18.068303 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-532e8518-9903-4325-a5fb-88d1f5865774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:18.085829 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 216/425] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:41:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:41:18.086897 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb5df6-cfbc-40ba-943e-309fa0d02d7c None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:18.149506 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 210/426] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:41:18.150881 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e8518-9903-4325-a5fb-88d1f5865774 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:18.201243 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb5df6-cfbc-40ba-943e-309fa0d02d7c None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:18.235648 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65665453-478b-4d44-9c48-f181d042952f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:18.236937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65665453-478b-4d44-9c48-f181d042952f None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:18.237378 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65665453-478b-4d44-9c48-f181d042952f None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:18.237672 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65665453-478b-4d44-9c48-f181d042952f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:18.274754 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e8518-9903-4325-a5fb-88d1f5865774 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:18.306162 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65665453-478b-4d44-9c48-f181d042952f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:18.308052 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65665453-478b-4d44-9c48-f181d042952f None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:18.309739 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7598bbb-250d-49bd-9956-726208ae19e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:18.310600 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7598bbb-250d-49bd-9956-726208ae19e7 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:18.310885 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7598bbb-250d-49bd-9956-726208ae19e7 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:18.311166 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7598bbb-250d-49bd-9956-726208ae19e7 None admin] PATH_INFO: `/v3/projects/b65984e2c7ae400c829003b7ab39d8e2` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:18.312370 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7598bbb-250d-49bd-9956-726208ae19e7 None admin] RBAC: Authorizing `identity:get_project(project_id=b65984e2c7ae400c829003b7ab39d8e2)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:18.313941 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7598bbb-250d-49bd-9956-726208ae19e7 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:18.316505 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 211/427] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:41:18 2022] GET /identity/v3/projects/b65984e2c7ae400c829003b7ab39d8e2 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:18.318384 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7598bbb-250d-49bd-9956-726208ae19e7 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:18.411703 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 217/428] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:41:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:41:18.412565 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65665453-478b-4d44-9c48-f181d042952f None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:18.425032 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7598bbb-250d-49bd-9956-726208ae19e7 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:18.465076 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d184ed-68fa-459b-9369-a633b13c9b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:18.465874 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d184ed-68fa-459b-9369-a633b13c9b45 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:18.466159 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d184ed-68fa-459b-9369-a633b13c9b45 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:18.466434 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d184ed-68fa-459b-9369-a633b13c9b45 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:18.477877 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d184ed-68fa-459b-9369-a633b13c9b45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:41:18.489178 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-c7d184ed-68fa-459b-9369-a633b13c9b45 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:41:18.489178 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:18.489178 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:18.489178 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:18.489178 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:18.489178 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:18.489178 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:18.489178 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:18.489178 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:18.489178 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:18.489178 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:18.489178 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:18.489178 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:41:18.489178 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:41:18.489178 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:41:18.489178 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:41:18.491261 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:41:18.491261 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:41:18.491261 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:41:18.491261 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:41:18.491261 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:18.491261 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:18.491261 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:18.491261 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:18.491261 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:18.491261 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:18.491261 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:18.491261 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:18.491261 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:18.491261 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:18.491261 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:18.491261 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:18.493554 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:18.493554 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:18.493554 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:18.493554 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:18.493554 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:41:18.493554 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:41:18.493554 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:41:18.493554 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:41:18.493554 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:41:18.493554 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:41:18.493554 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:41:18.493554 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:18.493554 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 212/429] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:41:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:18.495093 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d184ed-68fa-459b-9369-a633b13c9b45 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:18.514252 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65665453-478b-4d44-9c48-f181d042952f None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:18.549520 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1faf8-4c4a-40e9-be7f-8aada08e56cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:18.550523 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1faf8-4c4a-40e9-be7f-8aada08e56cb None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:18.550804 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1faf8-4c4a-40e9-be7f-8aada08e56cb None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:18.551073 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1faf8-4c4a-40e9-be7f-8aada08e56cb None admin] PATH_INFO: `/v3/groups/9ddd9cff0769482e8b596c8f6f6deac6` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:18.552261 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1faf8-4c4a-40e9-be7f-8aada08e56cb None admin] RBAC: Authorizing `identity:get_group(group_id=9ddd9cff0769482e8b596c8f6f6deac6)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:18.553790 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1faf8-4c4a-40e9-be7f-8aada08e56cb None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:18.555693 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 218/430] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Apr 30 20:41:18 2022] GET /identity/v3/groups/9ddd9cff0769482e8b596c8f6f6deac6 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:18.556622 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1faf8-4c4a-40e9-be7f-8aada08e56cb None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:18.607648 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d184ed-68fa-459b-9369-a633b13c9b45 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:18.650141 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d21ef-4401-4a07-928d-84b6cb2aeff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:18.651000 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d21ef-4401-4a07-928d-84b6cb2aeff6 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:18.651275 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d21ef-4401-4a07-928d-84b6cb2aeff6 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:18.651550 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d21ef-4401-4a07-928d-84b6cb2aeff6 None admin] PATH_INFO: `/v3/projects/b65984e2c7ae400c829003b7ab39d8e2` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:18.652743 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d21ef-4401-4a07-928d-84b6cb2aeff6 None admin] RBAC: Authorizing `identity:get_project(project_id=b65984e2c7ae400c829003b7ab39d8e2)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:18.654331 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d21ef-4401-4a07-928d-84b6cb2aeff6 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:18.656394 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 213/431] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:41:18 2022] GET /identity/v3/projects/b65984e2c7ae400c829003b7ab39d8e2 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:18.657241 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d21ef-4401-4a07-928d-84b6cb2aeff6 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:18.664482 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1faf8-4c4a-40e9-be7f-8aada08e56cb None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:18.710252 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df0a78-7684-4ca4-ac3d-d98e1fd48cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:18.710937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df0a78-7684-4ca4-ac3d-d98e1fd48cf7 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:18.711222 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df0a78-7684-4ca4-ac3d-d98e1fd48cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:18.711499 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df0a78-7684-4ca4-ac3d-d98e1fd48cf7 None admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:18.712250 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df0a78-7684-4ca4-ac3d-d98e1fd48cf7 None admin] RBAC: Adding query filter params (name=member) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:18.713033 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df0a78-7684-4ca4-ac3d-d98e1fd48cf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:18.714721 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df0a78-7684-4ca4-ac3d-d98e1fd48cf7 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:18.726816 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 219/432] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Apr 30 20:41:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:18.727655 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df0a78-7684-4ca4-ac3d-d98e1fd48cf7 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:18.772928 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d21ef-4401-4a07-928d-84b6cb2aeff6 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:18.812019 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e36ec2-a782-4aae-8979-95ff577fd15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:18.812019 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e36ec2-a782-4aae-8979-95ff577fd15e None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:18.812019 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e36ec2-a782-4aae-8979-95ff577fd15e None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:18.812019 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e36ec2-a782-4aae-8979-95ff577fd15e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:18.815866 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e36ec2-a782-4aae-8979-95ff577fd15e None admin] RBAC: Adding query filter params (group.id=9ddd9cff0769482e8b596c8f6f6deac6, role.id=375abc9f701c408ea332eaf2d8a2e086, scope.project.id=b65984e2c7ae400c829003b7ab39d8e2) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:18.815866 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e36ec2-a782-4aae-8979-95ff577fd15e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:18.824930 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e36ec2-a782-4aae-8979-95ff577fd15e None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:18.825488 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 214/433] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Apr 30 20:41:18 2022] GET /identity/v3/role_assignments?group.id=9ddd9cff0769482e8b596c8f6f6deac6&scope.project.id=b65984e2c7ae400c829003b7ab39d8e2&role.id=375abc9f701c408ea332eaf2d8a2e086 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:18.825860 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e36ec2-a782-4aae-8979-95ff577fd15e None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:18.837466 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df0a78-7684-4ca4-ac3d-d98e1fd48cf7 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:18.875250 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5237a3-cec3-4e8e-871e-a96f70ed65fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:18.876111 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5237a3-cec3-4e8e-871e-a96f70ed65fb None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:18.876435 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5237a3-cec3-4e8e-871e-a96f70ed65fb None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:18.877298 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5237a3-cec3-4e8e-871e-a96f70ed65fb None admin] PATH_INFO: `/v3/groups/9ddd9cff0769482e8b596c8f6f6deac6` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:18.878611 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5237a3-cec3-4e8e-871e-a96f70ed65fb None admin] RBAC: Authorizing `identity:get_group(group_id=9ddd9cff0769482e8b596c8f6f6deac6)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:18.880116 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5237a3-cec3-4e8e-871e-a96f70ed65fb None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:18.882190 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 220/434] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Apr 30 20:41:18 2022] GET /identity/v3/groups/9ddd9cff0769482e8b596c8f6f6deac6 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:18.890249 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5237a3-cec3-4e8e-871e-a96f70ed65fb None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:18.995393 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e36ec2-a782-4aae-8979-95ff577fd15e None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:19.062344 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5237a3-cec3-4e8e-871e-a96f70ed65fb None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:19.067244 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8e831-60b7-4bac-8520-11f6b1d0857f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:19.067901 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8e831-60b7-4bac-8520-11f6b1d0857f None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:19.068184 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8e831-60b7-4bac-8520-11f6b1d0857f None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:19.068456 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8e831-60b7-4bac-8520-11f6b1d0857f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:19.099990 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea96ec-ccff-4d18-8226-94f3d516dd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:19.101816 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea96ec-ccff-4d18-8226-94f3d516dd45 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:19.101816 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea96ec-ccff-4d18-8226-94f3d516dd45 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:19.101816 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea96ec-ccff-4d18-8226-94f3d516dd45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:19.103237 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea96ec-ccff-4d18-8226-94f3d516dd45 None admin] RBAC: Adding query filter params (group.id=9ddd9cff0769482e8b596c8f6f6deac6, role.id=f76bb9b1c47a4fbfa232de16b0b4a0d5, scope.project.id=b65984e2c7ae400c829003b7ab39d8e2) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:19.103237 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea96ec-ccff-4d18-8226-94f3d516dd45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:19.105477 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea96ec-ccff-4d18-8226-94f3d516dd45 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:19.110776 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 221/435] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Apr 30 20:41:18 2022] GET /identity/v3/role_assignments?group.id=9ddd9cff0769482e8b596c8f6f6deac6&scope.project.id=b65984e2c7ae400c829003b7ab39d8e2&role.id=f76bb9b1c47a4fbfa232de16b0b4a0d5 => generated 611 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:19.182404 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a8e831-60b7-4bac-8520-11f6b1d0857f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:19.183893 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a8e831-60b7-4bac-8520-11f6b1d0857f None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:19.306260 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 215/436] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:41:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:41:19.311728 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea96ec-ccff-4d18-8226-94f3d516dd45 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:19.350216 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96720d-db30-4723-8b52-3598c72fe07e None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:19.350595 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96720d-db30-4723-8b52-3598c72fe07e None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:19.351310 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96720d-db30-4723-8b52-3598c72fe07e None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:19.354145 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 216/437] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:19.362809 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ad2e7-cf01-4ddb-8e3a-5d73a040b109 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:19.363094 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ad2e7-cf01-4ddb-8e3a-5d73a040b109 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:19.363373 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ad2e7-cf01-4ddb-8e3a-5d73a040b109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:19.386062 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-cb7ad2e7-cf01-4ddb-8e3a-5d73a040b109 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:19.387261 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-cb7ad2e7-cf01-4ddb-8e3a-5d73a040b109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:19.432024 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea96ec-ccff-4d18-8226-94f3d516dd45 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:19.472823 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 217/438] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:41:19.474566 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e03c9d-eda0-44af-96ea-7adc2052772e None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:19.474679 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e03c9d-eda0-44af-96ea-7adc2052772e None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:19.474871 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e03c9d-eda0-44af-96ea-7adc2052772e None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:19.476944 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 218/439] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:19.480584 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dec4a9-fb88-49b6-b8a3-b1a83d37e6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:19.481547 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dec4a9-fb88-49b6-b8a3-b1a83d37e6f5 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:19.481830 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dec4a9-fb88-49b6-b8a3-b1a83d37e6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:19.482104 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dec4a9-fb88-49b6-b8a3-b1a83d37e6f5 None admin] PATH_INFO: `/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:19.482611 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50062c41-daa5-4dd3-9a9f-f8715b43521f None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:19.482893 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50062c41-daa5-4dd3-9a9f-f8715b43521f None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:19.483166 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50062c41-daa5-4dd3-9a9f-f8715b43521f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:19.483356 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dec4a9-fb88-49b6-b8a3-b1a83d37e6f5 None admin] RBAC: Authorizing `identity:get_project(project_id=5141353bfd044a1ba7fb8ba70efe9a73)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:19.484817 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dec4a9-fb88-49b6-b8a3-b1a83d37e6f5 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:19.486691 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 222/440] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:41:19 2022] GET /identity/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:19.492770 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dec4a9-fb88-49b6-b8a3-b1a83d37e6f5 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:19.503522 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-50062c41-daa5-4dd3-9a9f-f8715b43521f None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:19.504706 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-50062c41-daa5-4dd3-9a9f-f8715b43521f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:19.587527 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 219/441] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:41:19.588790 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50062c41-daa5-4dd3-9a9f-f8715b43521f None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:19.608612 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dec4a9-fb88-49b6-b8a3-b1a83d37e6f5 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:19.651412 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5a4ea-5314-47b9-98d4-38a8ef104b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:19.652273 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5a4ea-5314-47b9-98d4-38a8ef104b62 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:19.652556 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5a4ea-5314-47b9-98d4-38a8ef104b62 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:19.652829 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5a4ea-5314-47b9-98d4-38a8ef104b62 None admin] PATH_INFO: `/v3/groups/9ddd9cff0769482e8b596c8f6f6deac6` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:19.654071 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a5a4ea-5314-47b9-98d4-38a8ef104b62 None admin] RBAC: Authorizing `identity:get_group(group_id=9ddd9cff0769482e8b596c8f6f6deac6)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:19.655659 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a5a4ea-5314-47b9-98d4-38a8ef104b62 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:19.657404 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 223/442] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Apr 30 20:41:19 2022] GET /identity/v3/groups/9ddd9cff0769482e8b596c8f6f6deac6 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:41:19.658195 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5a4ea-5314-47b9-98d4-38a8ef104b62 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:19.703949 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50062c41-daa5-4dd3-9a9f-f8715b43521f None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:19.740821 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb88904-05f0-4b74-8815-49e6d82bfee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:19.741793 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb88904-05f0-4b74-8815-49e6d82bfee0 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:19.742077 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb88904-05f0-4b74-8815-49e6d82bfee0 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:19.742351 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb88904-05f0-4b74-8815-49e6d82bfee0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:19.754786 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb88904-05f0-4b74-8815-49e6d82bfee0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:41:19.762277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-5fb88904-05f0-4b74-8815-49e6d82bfee0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:41:19.762277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:19.762277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:19.762277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:19.762277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:19.762277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:19.762277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:19.762277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:19.762277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:19.762277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:19.762277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:19.762277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:19.762277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:41:19.762277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:41:19.762277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:41:19.762277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:41:19.763483 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:41:19.763483 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:41:19.763483 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:41:19.763483 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:41:19.763483 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:19.763483 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:19.763483 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:19.763483 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:19.763483 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:19.763483 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:19.763483 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:19.763483 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:19.763483 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:19.763483 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:19.763483 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:19.763483 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:19.764948 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:19.764948 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:19.764948 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:19.764948 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:19.764948 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:41:19.764948 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:41:19.764948 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:41:19.764948 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:41:19.764948 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:41:19.764948 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:41:19.764948 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:41:19.764948 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:19.764948 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 220/443] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Apr 30 20:41:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:19.764948 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb88904-05f0-4b74-8815-49e6d82bfee0 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:19.775812 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5a4ea-5314-47b9-98d4-38a8ef104b62 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:19.808082 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016026f-4140-4066-8eb7-c35b3859cb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:19.808888 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016026f-4140-4066-8eb7-c35b3859cb2d None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:19.809189 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016026f-4140-4066-8eb7-c35b3859cb2d None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:19.809479 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016026f-4140-4066-8eb7-c35b3859cb2d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:19.821227 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016026f-4140-4066-8eb7-c35b3859cb2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:41:19.829353 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-d016026f-4140-4066-8eb7-c35b3859cb2d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:41:19.829353 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:19.829353 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:19.829353 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:19.829353 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:19.829353 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:19.829353 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:19.829353 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:19.829353 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:19.829353 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:19.829353 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:19.829353 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:19.829353 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:41:19.829353 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:41:19.829353 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:41:19.829353 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:41:19.830443 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:41:19.830443 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:41:19.830443 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:41:19.830443 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:41:19.830443 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:19.830443 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:19.830443 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:19.830443 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:19.830443 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:19.830443 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:19.830443 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:19.830443 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:19.830443 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:19.830443 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:19.830443 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:19.830443 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:19.831306 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:19.831306 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:19.831306 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:19.831306 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:19.831306 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:41:19.831306 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:41:19.831306 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:41:19.831306 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:41:19.831306 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:41:19.831306 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:41:19.831306 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:41:19.831306 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:19.831306 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 224/444] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Apr 30 20:41:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:19.831977 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016026f-4140-4066-8eb7-c35b3859cb2d None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:19.872543 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb88904-05f0-4b74-8815-49e6d82bfee0 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:19.903907 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5ada1-76d5-43bf-8c60-e4c161501f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:19.904618 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5ada1-76d5-43bf-8c60-e4c161501f76 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:19.904932 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5ada1-76d5-43bf-8c60-e4c161501f76 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:19.905198 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5ada1-76d5-43bf-8c60-e4c161501f76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:19.906014 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5ada1-76d5-43bf-8c60-e4c161501f76 None admin] RBAC: Adding query filter params (group.id=9ddd9cff0769482e8b596c8f6f6deac6, role.id=375abc9f701c408ea332eaf2d8a2e086, scope.project.id=5141353bfd044a1ba7fb8ba70efe9a73) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:19.906323 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5ada1-76d5-43bf-8c60-e4c161501f76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:19.907741 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5ada1-76d5-43bf-8c60-e4c161501f76 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:19.914182 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 221/445] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Apr 30 20:41:19 2022] GET /identity/v3/role_assignments?group.id=9ddd9cff0769482e8b596c8f6f6deac6&scope.project.id=5141353bfd044a1ba7fb8ba70efe9a73&role.id=375abc9f701c408ea332eaf2d8a2e086 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:19.914947 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5ada1-76d5-43bf-8c60-e4c161501f76 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:19.930730 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016026f-4140-4066-8eb7-c35b3859cb2d None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:19.966393 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9f0f6-8c29-4491-9fca-26f0dee10615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:19.967068 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9f0f6-8c29-4491-9fca-26f0dee10615 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:19.967348 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9f0f6-8c29-4491-9fca-26f0dee10615 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:19.967627 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9f0f6-8c29-4491-9fca-26f0dee10615 None admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:19.968377 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9f0f6-8c29-4491-9fca-26f0dee10615 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:19.968685 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9f0f6-8c29-4491-9fca-26f0dee10615 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:19.970159 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9f0f6-8c29-4491-9fca-26f0dee10615 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:19.980370 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 225/446] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:41:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:19.985861 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9f0f6-8c29-4491-9fca-26f0dee10615 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:20.025599 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5ada1-76d5-43bf-8c60-e4c161501f76 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:20.062602 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03df604-fce7-447d-acb4-a5bf8857977b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:20.063698 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03df604-fce7-447d-acb4-a5bf8857977b None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:20.063978 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03df604-fce7-447d-acb4-a5bf8857977b None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:20.065439 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03df604-fce7-447d-acb4-a5bf8857977b None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:20.065990 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03df604-fce7-447d-acb4-a5bf8857977b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:20.066299 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03df604-fce7-447d-acb4-a5bf8857977b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:20.067705 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03df604-fce7-447d-acb4-a5bf8857977b None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:20.076491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 222/447] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:41:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:20.082592 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03df604-fce7-447d-acb4-a5bf8857977b None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:20.099810 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9f0f6-8c29-4491-9fca-26f0dee10615 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:20.141787 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304470a6-0e99-4c13-a999-2f42ce892903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:20.142707 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304470a6-0e99-4c13-a999-2f42ce892903 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:20.143030 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304470a6-0e99-4c13-a999-2f42ce892903 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:20.143309 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304470a6-0e99-4c13-a999-2f42ce892903 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:20.190868 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03df604-fce7-447d-acb4-a5bf8857977b None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:20.220111 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304470a6-0e99-4c13-a999-2f42ce892903 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:20.223516 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304470a6-0e99-4c13-a999-2f42ce892903 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:20.231034 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebb150-1ffe-4d2e-a2d7-7614dcf26693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:20.231752 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebb150-1ffe-4d2e-a2d7-7614dcf26693 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:20.232033 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebb150-1ffe-4d2e-a2d7-7614dcf26693 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:20.232330 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebb150-1ffe-4d2e-a2d7-7614dcf26693 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:20.308293 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ebb150-1ffe-4d2e-a2d7-7614dcf26693 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:20.309826 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ebb150-1ffe-4d2e-a2d7-7614dcf26693 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:20.332042 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 226/448] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:41:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 30 20:41:20.337407 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304470a6-0e99-4c13-a999-2f42ce892903 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:20.405008 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 223/449] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:41:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 30 20:41:20.410396 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebb150-1ffe-4d2e-a2d7-7614dcf26693 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:20.430312 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304470a6-0e99-4c13-a999-2f42ce892903 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:20.462632 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b36ea-2083-47c5-890e-df79433c886a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:20.463461 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b36ea-2083-47c5-890e-df79433c886a None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:20.463744 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b36ea-2083-47c5-890e-df79433c886a None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:20.464021 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b36ea-2083-47c5-890e-df79433c886a None admin] PATH_INFO: `/v3/projects/d7eaab61e23a485db5f1e2bf1736a9f5` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:20.465242 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b36ea-2083-47c5-890e-df79433c886a None admin] RBAC: Authorizing `identity:get_project(project_id=d7eaab61e23a485db5f1e2bf1736a9f5)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:20.466723 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b36ea-2083-47c5-890e-df79433c886a None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:20.468400 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 227/450] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:41:20 2022] GET /identity/v3/projects/d7eaab61e23a485db5f1e2bf1736a9f5 => generated 344 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:41:20.474540 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b36ea-2083-47c5-890e-df79433c886a None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:20.503346 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebb150-1ffe-4d2e-a2d7-7614dcf26693 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:20.536119 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f8573-04ab-4ad3-9856-95e378c144e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:20.536996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f8573-04ab-4ad3-9856-95e378c144e4 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:20.537274 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f8573-04ab-4ad3-9856-95e378c144e4 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:20.537544 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f8573-04ab-4ad3-9856-95e378c144e4 None admin] PATH_INFO: `/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:20.538712 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f8573-04ab-4ad3-9856-95e378c144e4 None admin] RBAC: Authorizing `identity:get_project(project_id=5141353bfd044a1ba7fb8ba70efe9a73)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:20.540143 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f8573-04ab-4ad3-9856-95e378c144e4 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:20.541829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 224/451] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Apr 30 20:41:20 2022] GET /identity/v3/projects/5141353bfd044a1ba7fb8ba70efe9a73 => generated 302 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:41:20.547153 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f8573-04ab-4ad3-9856-95e378c144e4 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:20.570153 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b36ea-2083-47c5-890e-df79433c886a None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:20.602641 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d93a7-6652-4293-9351-d80f2f880337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:20.603528 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d93a7-6652-4293-9351-d80f2f880337 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:20.603806 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d93a7-6652-4293-9351-d80f2f880337 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:20.604072 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d93a7-6652-4293-9351-d80f2f880337 None admin] PATH_INFO: `/v3/groups/f7205ff03574424db8b5ac5ed5bdd0c2` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:20.605258 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d93a7-6652-4293-9351-d80f2f880337 None admin] RBAC: Authorizing `identity:get_group(group_id=f7205ff03574424db8b5ac5ed5bdd0c2)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:20.606686 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d93a7-6652-4293-9351-d80f2f880337 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:20.608271 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 228/452] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Apr 30 20:41:20 2022] GET /identity/v3/groups/f7205ff03574424db8b5ac5ed5bdd0c2 => generated 229 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:41:20.614523 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d93a7-6652-4293-9351-d80f2f880337 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:20.641045 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f8573-04ab-4ad3-9856-95e378c144e4 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:20.674150 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4254aa-2796-4bd0-b8a2-8cdaa0d61a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:20.675082 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4254aa-2796-4bd0-b8a2-8cdaa0d61a94 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:20.675363 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4254aa-2796-4bd0-b8a2-8cdaa0d61a94 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:20.675633 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4254aa-2796-4bd0-b8a2-8cdaa0d61a94 None admin] PATH_INFO: `/v3/groups/9ddd9cff0769482e8b596c8f6f6deac6` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:20.676811 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4254aa-2796-4bd0-b8a2-8cdaa0d61a94 None admin] RBAC: Authorizing `identity:get_group(group_id=9ddd9cff0769482e8b596c8f6f6deac6)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:20.678345 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4254aa-2796-4bd0-b8a2-8cdaa0d61a94 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:20.679961 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 225/453] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Apr 30 20:41:20 2022] GET /identity/v3/groups/9ddd9cff0769482e8b596c8f6f6deac6 => generated 226 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:41:20.685592 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4254aa-2796-4bd0-b8a2-8cdaa0d61a94 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:20.708811 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d93a7-6652-4293-9351-d80f2f880337 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:20.741381 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa1464-1ae2-466e-9d96-c4c5b753129e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:20.742026 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa1464-1ae2-466e-9d96-c4c5b753129e None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:20.742401 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa1464-1ae2-466e-9d96-c4c5b753129e None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:20.742682 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa1464-1ae2-466e-9d96-c4c5b753129e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:20.743494 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa1464-1ae2-466e-9d96-c4c5b753129e None admin] RBAC: Adding query filter params (group.id=f7205ff03574424db8b5ac5ed5bdd0c2, role.id=31b3f11a82cd4cd2823e88aa0e931323, scope.project.id=d7eaab61e23a485db5f1e2bf1736a9f5) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:20.743808 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa1464-1ae2-466e-9d96-c4c5b753129e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:20.745302 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa1464-1ae2-466e-9d96-c4c5b753129e None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:20.750837 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 229/454] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Apr 30 20:41:20 2022] GET /identity/v3/role_assignments?group.id=f7205ff03574424db8b5ac5ed5bdd0c2&scope.project.id=d7eaab61e23a485db5f1e2bf1736a9f5&role.id=31b3f11a82cd4cd2823e88aa0e931323 => generated 611 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:41:20.781869 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4254aa-2796-4bd0-b8a2-8cdaa0d61a94 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:20.822513 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190d02e-3641-4f18-86b4-65a83784fe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:20.823174 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190d02e-3641-4f18-86b4-65a83784fe9a None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:20.823453 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190d02e-3641-4f18-86b4-65a83784fe9a None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:20.823725 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190d02e-3641-4f18-86b4-65a83784fe9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:20.824553 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9190d02e-3641-4f18-86b4-65a83784fe9a None admin] RBAC: Adding query filter params (group.id=9ddd9cff0769482e8b596c8f6f6deac6, role.id=f76bb9b1c47a4fbfa232de16b0b4a0d5, scope.project.id=5141353bfd044a1ba7fb8ba70efe9a73) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:20.824862 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9190d02e-3641-4f18-86b4-65a83784fe9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:20.826359 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9190d02e-3641-4f18-86b4-65a83784fe9a None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:20.833791 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 226/455] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Apr 30 20:41:20 2022] GET /identity/v3/role_assignments?group.id=9ddd9cff0769482e8b596c8f6f6deac6&scope.project.id=5141353bfd044a1ba7fb8ba70efe9a73&role.id=f76bb9b1c47a4fbfa232de16b0b4a0d5 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:41:23.580566 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16cad1-bab3-43e3-8f7c-7b226a9e4bee None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:23.581111 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16cad1-bab3-43e3-8f7c-7b226a9e4bee None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:23.581187 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16cad1-bab3-43e3-8f7c-7b226a9e4bee None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:23.582747 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 230/456] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:23.588208 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197db0d9-3cfc-4079-9259-336c6d387be7 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:23.589082 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197db0d9-3cfc-4079-9259-336c6d387be7 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:23.589558 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197db0d9-3cfc-4079-9259-336c6d387be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:23.607813 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-197db0d9-3cfc-4079-9259-336c6d387be7 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:23.609461 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-197db0d9-3cfc-4079-9259-336c6d387be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:23.684196 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 227/457] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:41:23.710692 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16cad1-bab3-43e3-8f7c-7b226a9e4bee None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:23.816185 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16cad1-bab3-43e3-8f7c-7b226a9e4bee None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:23.817773 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a6cf1-6e64-4357-b096-92a85e8e0986 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:23.818316 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a6cf1-6e64-4357-b096-92a85e8e0986 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:23.818995 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a6cf1-6e64-4357-b096-92a85e8e0986 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:23.821694 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 228/458] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:41:23.826830 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68cf06-3750-412e-9503-5dc005d9137f None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:23.827724 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68cf06-3750-412e-9503-5dc005d9137f None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:23.828222 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68cf06-3750-412e-9503-5dc005d9137f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:23.849820 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-9d68cf06-3750-412e-9503-5dc005d9137f None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:23.851497 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-9d68cf06-3750-412e-9503-5dc005d9137f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:23.852629 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e4f8b-d7da-4a21-8819-c183e9cee399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:23.853459 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e4f8b-d7da-4a21-8819-c183e9cee399 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:23.853744 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e4f8b-d7da-4a21-8819-c183e9cee399 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:23.854021 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e4f8b-d7da-4a21-8819-c183e9cee399 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:23.865244 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e4f8b-d7da-4a21-8819-c183e9cee399 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:23.866714 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e4f8b-d7da-4a21-8819-c183e9cee399 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:23.885593 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-4e1e4f8b-d7da-4a21-8819-c183e9cee399 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:23.885593 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:23.885593 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:23.885593 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:23.885593 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:23.885593 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:23.885593 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:23.885593 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:23.885593 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:23.885593 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:23.885593 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:23.885593 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:23.885593 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:41:23.885593 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:41:23.885593 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:41:23.886589 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:41:23.886589 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:23.886589 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:23.886589 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:23.886589 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:23.886589 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:23.886589 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:23.886589 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:23.886589 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:23.886589 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:23.886589 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:23.886589 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:23.886589 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:23.886589 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:23.886589 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:23.886589 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:23.886589 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:23.887725 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:41:23.887725 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:41:23.887725 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:23.887725 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:23.887725 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 231/459] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:23.887993 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc3d0f-cf44-488b-a217-0950696725d0 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:23.888438 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc3d0f-cf44-488b-a217-0950696725d0 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:23.888556 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc3d0f-cf44-488b-a217-0950696725d0 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:23.894655 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 232/460] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:23.895660 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc3d0f-cf44-488b-a217-0950696725d0 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:23.925249 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 229/461] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:41:23.926727 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9b8e1-58d6-46f2-895e-007fdfcb3daa None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:23.927015 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9b8e1-58d6-46f2-895e-007fdfcb3daa None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:23.927291 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9b8e1-58d6-46f2-895e-007fdfcb3daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:23.948546 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-78b9b8e1-58d6-46f2-895e-007fdfcb3daa None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:23.950036 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-78b9b8e1-58d6-46f2-895e-007fdfcb3daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:24.010805 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc3d0f-cf44-488b-a217-0950696725d0 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:24.021803 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 230/462] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:41:24.022941 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9b8e1-58d6-46f2-895e-007fdfcb3daa None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:24.061807 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491bc06-b6e5-42c0-8244-837c40c4e954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:24.062763 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491bc06-b6e5-42c0-8244-837c40c4e954 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:24.063193 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491bc06-b6e5-42c0-8244-837c40c4e954 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:24.063640 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491bc06-b6e5-42c0-8244-837c40c4e954 None admin] PATH_INFO: `/v3/domains` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:24.064605 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491bc06-b6e5-42c0-8244-837c40c4e954 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:24.065106 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491bc06-b6e5-42c0-8244-837c40c4e954 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:24.066647 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491bc06-b6e5-42c0-8244-837c40c4e954 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:24.084328 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 233/463] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:41:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:24.085509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491bc06-b6e5-42c0-8244-837c40c4e954 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:24.127368 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9b8e1-58d6-46f2-895e-007fdfcb3daa None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:24.160288 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368e6e1-7237-42f4-8f0a-73529c30758b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:24.161105 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368e6e1-7237-42f4-8f0a-73529c30758b None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:24.161383 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368e6e1-7237-42f4-8f0a-73529c30758b None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:24.161657 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368e6e1-7237-42f4-8f0a-73529c30758b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:24.171785 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368e6e1-7237-42f4-8f0a-73529c30758b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:24.173272 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368e6e1-7237-42f4-8f0a-73529c30758b None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:24.187104 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491bc06-b6e5-42c0-8244-837c40c4e954 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:24.191464 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-d368e6e1-7237-42f4-8f0a-73529c30758b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:24.191464 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:24.191464 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:24.191464 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:24.191464 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:24.191464 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:24.191464 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:24.191464 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:24.191464 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:24.191464 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:24.191464 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:24.191464 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:24.191464 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:41:24.191464 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:41:24.191464 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:41:24.192451 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:41:24.192451 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:24.192451 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:24.192451 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:24.192451 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:24.192451 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:24.192451 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:24.192451 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:24.192451 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:24.192451 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:24.192451 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:24.192451 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:24.192451 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:24.192451 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:24.192451 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:24.192451 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:24.192451 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:24.193530 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:41:24.193530 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:41:24.193530 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:24.193530 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:24.193530 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 231/464] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:24.193787 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368e6e1-7237-42f4-8f0a-73529c30758b None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:24.219933 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e2f53-f643-4035-9c18-67f2edf5ce49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:24.221384 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e2f53-f643-4035-9c18-67f2edf5ce49 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:24.221731 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e2f53-f643-4035-9c18-67f2edf5ce49 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:24.222011 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e2f53-f643-4035-9c18-67f2edf5ce49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:24.231902 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e2f53-f643-4035-9c18-67f2edf5ce49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:24.233444 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e2f53-f643-4035-9c18-67f2edf5ce49 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:24.253037 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-d98e2f53-f643-4035-9c18-67f2edf5ce49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:24.253037 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:24.253037 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:24.253037 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:24.253037 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:24.253037 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:24.253037 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:24.253037 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:24.253037 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:24.253037 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:24.253037 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:24.253037 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:24.253037 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:41:24.253037 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:41:24.253037 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:41:24.254055 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:41:24.254055 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:24.254055 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:24.254055 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:24.254055 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:24.254055 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:24.254055 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:24.254055 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:24.254055 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:24.254055 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:24.254055 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:24.254055 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:24.254055 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:24.254055 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:24.254055 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:24.254055 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:24.254055 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:24.254928 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:41:24.254928 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:41:24.254928 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:24.254928 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:24.254928 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 234/465] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:24.255520 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42526477-7e49-4453-9025-a2a0abb468af None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:24.255793 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42526477-7e49-4453-9025-a2a0abb468af None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:24.256076 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42526477-7e49-4453-9025-a2a0abb468af None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:24.257381 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 235/466] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:24.258075 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42526477-7e49-4453-9025-a2a0abb468af None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:24.294405 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368e6e1-7237-42f4-8f0a-73529c30758b None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:24.326049 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1d8c9-a4a1-4c19-bc6a-f5c5997b34f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:24.326705 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1d8c9-a4a1-4c19-bc6a-f5c5997b34f1 None admin] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:24.326982 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1d8c9-a4a1-4c19-bc6a-f5c5997b34f1 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:24.327250 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1d8c9-a4a1-4c19-bc6a-f5c5997b34f1 None admin] PATH_INFO: `/v3/users` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:24.327938 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1d8c9-a4a1-4c19-bc6a-f5c5997b34f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:24.329383 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1d8c9-a4a1-4c19-bc6a-f5c5997b34f1 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:24.356226 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42526477-7e49-4453-9025-a2a0abb468af None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:24.388397 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f1b91-eb94-4fda-9157-e3a36d0de708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:24.388990 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f1b91-eb94-4fda-9157-e3a36d0de708 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:24.389270 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f1b91-eb94-4fda-9157-e3a36d0de708 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:24.389542 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f1b91-eb94-4fda-9157-e3a36d0de708 None admin] PATH_INFO: `/v3/domains` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:24.390245 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f1b91-eb94-4fda-9157-e3a36d0de708 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:24.390546 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f1b91-eb94-4fda-9157-e3a36d0de708 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:24.392023 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f1b91-eb94-4fda-9157-e3a36d0de708 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:24.403437 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 236/467] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:24.416967 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 232/468] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Apr 30 20:41:24 2022] POST /identity/v3/users => generated 246 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:41:24.417265 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f1b91-eb94-4fda-9157-e3a36d0de708 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:24.417358 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce3c90-f900-40a5-9201-5b8428c6fde1 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:24.417358 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce3c90-f900-40a5-9201-5b8428c6fde1 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:24.417358 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce3c90-f900-40a5-9201-5b8428c6fde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:24.424861 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-f1ce3c90-f900-40a5-9201-5b8428c6fde1 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:24.426256 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-f1ce3c90-f900-40a5-9201-5b8428c6fde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:24.505662 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 233/469] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:41:24.505662 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce3c90-f900-40a5-9201-5b8428c6fde1 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:24.517993 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f1b91-eb94-4fda-9157-e3a36d0de708 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:24.554670 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db4b26-faa4-43ea-8bd7-1f09f10b5cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:24.555666 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db4b26-faa4-43ea-8bd7-1f09f10b5cf5 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:24.556149 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db4b26-faa4-43ea-8bd7-1f09f10b5cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:24.556424 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db4b26-faa4-43ea-8bd7-1f09f10b5cf5 None admin] PATH_INFO: `/v3/domains` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:24.557204 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db4b26-faa4-43ea-8bd7-1f09f10b5cf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:24.557515 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db4b26-faa4-43ea-8bd7-1f09f10b5cf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:24.558935 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db4b26-faa4-43ea-8bd7-1f09f10b5cf5 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:24.572161 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 237/470] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:24.592619 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db4b26-faa4-43ea-8bd7-1f09f10b5cf5 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:24.618369 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce3c90-f900-40a5-9201-5b8428c6fde1 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:24.655619 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169b91a-5a85-4137-8dc9-98c4fe75b8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:24.656212 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169b91a-5a85-4137-8dc9-98c4fe75b8db None admin] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:24.656496 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169b91a-5a85-4137-8dc9-98c4fe75b8db None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:24.656771 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169b91a-5a85-4137-8dc9-98c4fe75b8db None admin] PATH_INFO: `/v3/users` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:24.657516 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169b91a-5a85-4137-8dc9-98c4fe75b8db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:24.659641 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169b91a-5a85-4137-8dc9-98c4fe75b8db None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:24.676689 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db4b26-faa4-43ea-8bd7-1f09f10b5cf5 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:24.709621 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5188e5-306a-4af3-b948-d97a193e2e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:24.710422 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5188e5-306a-4af3-b948-d97a193e2e32 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:24.710747 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5188e5-306a-4af3-b948-d97a193e2e32 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:24.710975 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5188e5-306a-4af3-b948-d97a193e2e32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:24.721572 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5188e5-306a-4af3-b948-d97a193e2e32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:24.723036 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5188e5-306a-4af3-b948-d97a193e2e32 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:24.741566 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-ab5188e5-306a-4af3-b948-d97a193e2e32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:24.741566 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:24.741566 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:24.741566 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:24.741566 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:24.741566 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:24.741566 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:24.741566 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:24.741566 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:24.741566 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:24.741566 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:24.741566 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:24.741566 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:41:24.741566 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:41:24.741566 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:41:24.742583 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:41:24.742583 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:24.742583 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:24.742583 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:24.742583 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:24.742583 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:24.742583 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:24.742583 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:24.742583 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:24.742583 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:24.742583 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:24.742583 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:24.742583 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:24.742583 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:24.742583 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:24.742583 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:24.742583 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:24.743796 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:41:24.743796 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:41:24.743796 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:24.743796 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:24.743796 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 238/471] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:24.743796 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5188e5-306a-4af3-b948-d97a193e2e32 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:24.883688 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5188e5-306a-4af3-b948-d97a193e2e32 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:24.917170 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88e966-cef8-47e1-ba14-1c8ecc76c023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:24.917329 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 234/472] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Apr 30 20:41:24 2022] POST /identity/v3/users => generated 248 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:41:24.918102 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169b91a-5a85-4137-8dc9-98c4fe75b8db None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:24.918323 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88e966-cef8-47e1-ba14-1c8ecc76c023 None admin] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:24.918750 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88e966-cef8-47e1-ba14-1c8ecc76c023 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:24.919161 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88e966-cef8-47e1-ba14-1c8ecc76c023 None admin] PATH_INFO: `/v3/users` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:24.919877 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88e966-cef8-47e1-ba14-1c8ecc76c023 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:24.921415 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88e966-cef8-47e1-ba14-1c8ecc76c023 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:25.021664 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 239/473] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Apr 30 20:41:24 2022] POST /identity/v3/users => generated 248 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:41:25.039551 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169b91a-5a85-4137-8dc9-98c4fe75b8db None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:25.081245 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff086372-fe36-4131-8a1d-9191321a8ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:25.082314 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff086372-fe36-4131-8a1d-9191321a8ce9 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:25.082781 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff086372-fe36-4131-8a1d-9191321a8ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:25.083254 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff086372-fe36-4131-8a1d-9191321a8ce9 None admin] PATH_INFO: `/v3/domains` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:25.084226 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff086372-fe36-4131-8a1d-9191321a8ce9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:25.084727 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff086372-fe36-4131-8a1d-9191321a8ce9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:25.086500 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff086372-fe36-4131-8a1d-9191321a8ce9 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:25.101736 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 235/474] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:25.107773 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88e966-cef8-47e1-ba14-1c8ecc76c023 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:25.223664 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88e966-cef8-47e1-ba14-1c8ecc76c023 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:25.261696 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afca3f9-36b9-45a3-8959-f7fafb3b58c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:25.262379 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afca3f9-36b9-45a3-8959-f7fafb3b58c3 None admin] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:25.262665 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afca3f9-36b9-45a3-8959-f7fafb3b58c3 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:25.263015 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afca3f9-36b9-45a3-8959-f7fafb3b58c3 None admin] PATH_INFO: `/v3/users` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:25.263661 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afca3f9-36b9-45a3-8959-f7fafb3b58c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:25.265254 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afca3f9-36b9-45a3-8959-f7fafb3b58c3 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:25.342588 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 240/475] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Apr 30 20:41:25 2022] POST /identity/v3/users => generated 249 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:41:26.790077 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07d2a9-7992-4bf1-bde3-420200d5c52a None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:26.790600 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07d2a9-7992-4bf1-bde3-420200d5c52a None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:26.790600 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07d2a9-7992-4bf1-bde3-420200d5c52a None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:26.792247 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 236/476] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:26.797706 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef4487-0d6d-41b7-a28e-caf723530b22 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:26.798118 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef4487-0d6d-41b7-a28e-caf723530b22 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:26.798287 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef4487-0d6d-41b7-a28e-caf723530b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:26.815704 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-5cef4487-0d6d-41b7-a28e-caf723530b22 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:26.816937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-5cef4487-0d6d-41b7-a28e-caf723530b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:26.884652 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 241/477] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:41:26.911598 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07d2a9-7992-4bf1-bde3-420200d5c52a None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:27.014995 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07d2a9-7992-4bf1-bde3-420200d5c52a None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:27.051694 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388f846-79a3-4a59-9a31-93e8beef48ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:27.052410 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388f846-79a3-4a59-9a31-93e8beef48ea None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:27.052686 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388f846-79a3-4a59-9a31-93e8beef48ea None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:27.052988 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388f846-79a3-4a59-9a31-93e8beef48ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:27.063283 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388f846-79a3-4a59-9a31-93e8beef48ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:41:27.070973 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-4388f846-79a3-4a59-9a31-93e8beef48ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:41:27.070973 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:27.070973 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:27.070973 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:27.070973 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:27.070973 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:27.070973 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:27.070973 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:27.070973 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:27.070973 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:27.070973 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:27.070973 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:27.070973 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:41:27.070973 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:41:27.070973 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:41:27.070973 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:41:27.073241 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:41:27.073241 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:41:27.073241 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:41:27.073241 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:41:27.073241 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:27.073241 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:27.073241 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:27.073241 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:27.073241 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:27.073241 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:27.073241 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:27.073241 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:27.073241 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:27.073241 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:27.073241 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:27.073241 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:27.075306 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:27.075306 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:27.075306 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:27.075306 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:27.075306 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:41:27.075306 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:41:27.075306 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:41:27.075306 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:41:27.075306 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:41:27.075306 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:41:27.075306 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:41:27.075306 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:27.075306 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 237/478] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Apr 30 20:41:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:27.082398 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef4487-0d6d-41b7-a28e-caf723530b22 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:27.183977 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef4487-0d6d-41b7-a28e-caf723530b22 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:27.223930 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8c0bb-afc1-4afe-b8ad-873e0a995848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:27.224957 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8c0bb-afc1-4afe-b8ad-873e0a995848 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:27.225431 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8c0bb-afc1-4afe-b8ad-873e0a995848 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:27.226131 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8c0bb-afc1-4afe-b8ad-873e0a995848 None admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:27.227058 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8c0bb-afc1-4afe-b8ad-873e0a995848 None admin] RBAC: Adding query filter params (name=service) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:27.227533 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8c0bb-afc1-4afe-b8ad-873e0a995848 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:27.229114 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8c0bb-afc1-4afe-b8ad-873e0a995848 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:27.238384 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 242/479] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Apr 30 20:41:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:27.243943 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388f846-79a3-4a59-9a31-93e8beef48ea None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:27.349527 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388f846-79a3-4a59-9a31-93e8beef48ea None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:27.385371 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896bac8-3fcf-4067-b1ca-e21327c01c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:27.386481 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896bac8-3fcf-4067-b1ca-e21327c01c58 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:27.386942 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896bac8-3fcf-4067-b1ca-e21327c01c58 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:27.387407 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896bac8-3fcf-4067-b1ca-e21327c01c58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:27.390399 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2c8ef-b9c7-4fff-a4bf-32259906fb56 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:27.390875 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2c8ef-b9c7-4fff-a4bf-32259906fb56 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:27.391348 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2c8ef-b9c7-4fff-a4bf-32259906fb56 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:27.393895 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 243/480] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:27.401971 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a98c0b-8434-4d16-ace8-c62592ce6af8 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:27.402644 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a98c0b-8434-4d16-ace8-c62592ce6af8 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:27.403130 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a98c0b-8434-4d16-ace8-c62592ce6af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:27.407730 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896bac8-3fcf-4067-b1ca-e21327c01c58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:27.409837 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896bac8-3fcf-4067-b1ca-e21327c01c58 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:27.422009 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-81a98c0b-8434-4d16-ace8-c62592ce6af8 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:27.423207 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-81a98c0b-8434-4d16-ace8-c62592ce6af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:27.428996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-b896bac8-3fcf-4067-b1ca-e21327c01c58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:27.428996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:27.428996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:27.428996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:27.428996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:27.428996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:27.428996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:27.428996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:27.428996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:27.428996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:27.428996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:27.428996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:27.428996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:41:27.428996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:41:27.428996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:41:27.429847 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:41:27.429847 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:27.429847 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:27.429847 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:27.429847 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:27.429847 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:27.429847 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:27.429847 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:27.429847 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:27.429847 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:27.429847 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:27.429847 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:27.429847 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:27.429847 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:27.429847 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:27.429847 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:27.429847 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:27.430692 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:41:27.430692 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:41:27.430692 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:27.430692 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:27.432563 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 238/481] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:27.438039 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896bac8-3fcf-4067-b1ca-e21327c01c58 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:27.497290 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 244/482] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:41:27.498697 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72213d43-eeb4-44b3-b2a6-a3abd75cb403 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:27.498993 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72213d43-eeb4-44b3-b2a6-a3abd75cb403 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:27.499277 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72213d43-eeb4-44b3-b2a6-a3abd75cb403 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:27.500667 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 245/483] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:27.506025 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea81127-f04d-4fcd-90a2-f948a10a316d None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:27.506337 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea81127-f04d-4fcd-90a2-f948a10a316d None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:27.506608 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea81127-f04d-4fcd-90a2-f948a10a316d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:27.524812 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-8ea81127-f04d-4fcd-90a2-f948a10a316d None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:27.526044 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-8ea81127-f04d-4fcd-90a2-f948a10a316d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:27.545418 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896bac8-3fcf-4067-b1ca-e21327c01c58 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:27.577867 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bdc4a2-c713-468e-8b3b-89171db71ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:27.578520 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdc4a2-c713-468e-8b3b-89171db71ff0 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:27.578799 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdc4a2-c713-468e-8b3b-89171db71ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:27.579074 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdc4a2-c713-468e-8b3b-89171db71ff0 None admin] PATH_INFO: `/v3/domains` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:27.580393 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bdc4a2-c713-468e-8b3b-89171db71ff0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:27.580701 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bdc4a2-c713-468e-8b3b-89171db71ff0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:27.582199 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bdc4a2-c713-468e-8b3b-89171db71ff0 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:27.593526 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 239/484] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:41:27.594311 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bdc4a2-c713-468e-8b3b-89171db71ff0 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:27.701154 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 246/485] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:41:27.701154 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea81127-f04d-4fcd-90a2-f948a10a316d None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:27.763887 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bdc4a2-c713-468e-8b3b-89171db71ff0 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:27.797331 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898fcb7-748a-4560-8347-8379e9db97bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:27.798133 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898fcb7-748a-4560-8347-8379e9db97bb None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:27.798441 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898fcb7-748a-4560-8347-8379e9db97bb None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:27.798718 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898fcb7-748a-4560-8347-8379e9db97bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:27.804653 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea81127-f04d-4fcd-90a2-f948a10a316d None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:27.808708 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898fcb7-748a-4560-8347-8379e9db97bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:41:27.816876 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-9898fcb7-748a-4560-8347-8379e9db97bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:41:27.816876 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:27.816876 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:27.816876 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:27.816876 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:27.816876 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:27.816876 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:27.816876 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:27.816876 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:27.816876 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:27.816876 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:27.816876 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:27.816876 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:41:27.816876 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:41:27.816876 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:41:27.816876 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:41:27.817774 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:41:27.817774 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:41:27.817774 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:41:27.817774 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:41:27.817774 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:27.817774 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:27.817774 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:27.817774 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:27.817774 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:27.817774 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:27.817774 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:27.817774 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:27.817774 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:27.817774 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:27.817774 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:27.817774 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:27.818560 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:27.818560 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:27.818560 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:27.818560 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:27.818560 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:41:27.818560 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:41:27.818560 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:41:27.818560 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:41:27.818560 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:41:27.818560 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:41:27.818560 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:41:27.818560 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:27.822812 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 240/486] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Apr 30 20:41:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:27.823514 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898fcb7-748a-4560-8347-8379e9db97bb None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:27.838549 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c7a30-5925-4546-b5b4-9ea43de4f612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:27.839442 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c7a30-5925-4546-b5b4-9ea43de4f612 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:27.839610 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c7a30-5925-4546-b5b4-9ea43de4f612 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:27.839882 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c7a30-5925-4546-b5b4-9ea43de4f612 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:27.846847 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c7a30-5925-4546-b5b4-9ea43de4f612 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:27.848309 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c7a30-5925-4546-b5b4-9ea43de4f612 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:27.863890 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-f69c7a30-5925-4546-b5b4-9ea43de4f612 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 30 20:41:27.863890 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:27.863890 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:27.863890 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:27.863890 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:27.863890 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:27.863890 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:27.863890 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:27.863890 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:27.863890 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:27.863890 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:27.863890 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:27.863890 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:41:27.863890 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:41:27.863890 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:41:27.863890 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:41:27.864869 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:27.864869 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:27.864869 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:41:27.864869 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:41:27.864869 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:41:27.864869 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:41:27.864869 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:27.864869 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:27.864869 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:27.864869 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:27.864869 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:27.864869 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:27.864869 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:27.864869 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:27.864869 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:27.864869 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:27.864869 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:27.864869 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:27.865836 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:27.865836 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:27.865836 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:41:27.865836 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:41:27.865836 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:41:27.865836 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:41:27.865836 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:41:27.865836 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:41:27.865836 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Apr 30 20:41:27.865836 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:27.865836 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 247/487] 10.222.0.26 () {56 vars in 1093 bytes} [Sat Apr 30 20:41:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:27.866985 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65a5aa-a7bb-42b9-9c21-e04b570f65e0 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:27.866985 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65a5aa-a7bb-42b9-9c21-e04b570f65e0 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:27.866985 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65a5aa-a7bb-42b9-9c21-e04b570f65e0 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:27.868588 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 248/488] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:27.869874 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65a5aa-a7bb-42b9-9c21-e04b570f65e0 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:27.919863 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898fcb7-748a-4560-8347-8379e9db97bb None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:27.951353 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74794e5a-adc4-42d1-a612-cddea9bc2752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:27.952068 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74794e5a-adc4-42d1-a612-cddea9bc2752 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:27.952350 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74794e5a-adc4-42d1-a612-cddea9bc2752 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:27.952624 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74794e5a-adc4-42d1-a612-cddea9bc2752 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:27.962975 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74794e5a-adc4-42d1-a612-cddea9bc2752 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:41:27.967966 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65a5aa-a7bb-42b9-9c21-e04b570f65e0 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:27.970869 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-74794e5a-adc4-42d1-a612-cddea9bc2752 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:41:27.970869 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:27.970869 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:27.970869 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:27.970869 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:27.970869 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:27.970869 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:27.970869 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:27.970869 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:27.970869 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:27.970869 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:27.970869 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:27.970869 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:41:27.970869 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:41:27.970869 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:41:27.970869 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:41:27.971928 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:41:27.971928 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:41:27.971928 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:41:27.971928 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:41:27.971928 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:27.971928 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:27.971928 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:27.971928 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:27.971928 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:27.971928 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:27.971928 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:27.971928 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:27.971928 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:27.971928 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:27.971928 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:27.971928 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:27.972727 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:27.972727 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:27.972727 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:27.972727 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:27.972727 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:41:27.972727 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:41:27.972727 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:41:27.972727 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:41:27.972727 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:41:27.972727 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:41:27.972727 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:41:27.972727 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:27.972727 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 241/489] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Apr 30 20:41:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:27.973427 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74794e5a-adc4-42d1-a612-cddea9bc2752 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:28.000233 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f9e56-0408-450a-98cd-c9949dcd0a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:28.000886 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f9e56-0408-450a-98cd-c9949dcd0a68 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:28.001196 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f9e56-0408-450a-98cd-c9949dcd0a68 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:28.001966 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f9e56-0408-450a-98cd-c9949dcd0a68 None admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:28.002687 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f9e56-0408-450a-98cd-c9949dcd0a68 None admin] RBAC: Adding query filter params (name=service) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:28.002987 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f9e56-0408-450a-98cd-c9949dcd0a68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:28.004365 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f9e56-0408-450a-98cd-c9949dcd0a68 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:28.011857 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 249/490] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Apr 30 20:41:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:28.013032 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb0105-f673-4926-b4b5-3a44f5455e2c None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:28.013319 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb0105-f673-4926-b4b5-3a44f5455e2c None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:28.013593 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb0105-f673-4926-b4b5-3a44f5455e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:28.029012 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-babb0105-f673-4926-b4b5-3a44f5455e2c None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:28.030172 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-babb0105-f673-4926-b4b5-3a44f5455e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:28.068872 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74794e5a-adc4-42d1-a612-cddea9bc2752 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:28.093025 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 250/491] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:41:28.093832 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb0105-f673-4926-b4b5-3a44f5455e2c None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:28.101070 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13998b55-59ad-4e29-99bd-06892f8bc21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:28.101737 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13998b55-59ad-4e29-99bd-06892f8bc21b None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:28.102020 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13998b55-59ad-4e29-99bd-06892f8bc21b None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:28.102297 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13998b55-59ad-4e29-99bd-06892f8bc21b None admin] PATH_INFO: `/v3/users` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:28.103127 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13998b55-59ad-4e29-99bd-06892f8bc21b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:28.103438 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13998b55-59ad-4e29-99bd-06892f8bc21b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:28.104886 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13998b55-59ad-4e29-99bd-06892f8bc21b None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:28.141505 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 242/492] 10.222.0.26 () {56 vars in 1133 bytes} [Sat Apr 30 20:41:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:28.142445 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13998b55-59ad-4e29-99bd-06892f8bc21b None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:28.204727 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb0105-f673-4926-b4b5-3a44f5455e2c None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:28.235432 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13998b55-59ad-4e29-99bd-06892f8bc21b None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:28.237115 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a44f4-b502-4982-b636-37d1c3f04962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:28.237778 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a44f4-b502-4982-b636-37d1c3f04962 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:28.238064 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a44f4-b502-4982-b636-37d1c3f04962 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:28.238332 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a44f4-b502-4982-b636-37d1c3f04962 None admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:28.239065 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a44f4-b502-4982-b636-37d1c3f04962 None admin] RBAC: Adding query filter params (name=service) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:28.239367 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a44f4-b502-4982-b636-37d1c3f04962 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:28.240741 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a44f4-b502-4982-b636-37d1c3f04962 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:28.248538 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 251/493] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Apr 30 20:41:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:28.249351 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a44f4-b502-4982-b636-37d1c3f04962 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:28.268589 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f80fc1-295b-4794-9c11-f5ed07d29239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:28.269420 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f80fc1-295b-4794-9c11-f5ed07d29239 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:28.269705 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f80fc1-295b-4794-9c11-f5ed07d29239 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:28.269982 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f80fc1-295b-4794-9c11-f5ed07d29239 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:28.279746 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f80fc1-295b-4794-9c11-f5ed07d29239 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:28.281246 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f80fc1-295b-4794-9c11-f5ed07d29239 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:28.299130 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-75f80fc1-295b-4794-9c11-f5ed07d29239 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:28.299130 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:28.299130 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:28.299130 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:28.299130 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:28.299130 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:28.299130 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:28.299130 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:28.299130 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:28.299130 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:28.299130 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:28.299130 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:28.299130 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:41:28.299130 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:41:28.299130 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:41:28.300011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:41:28.300011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:28.300011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:28.300011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:28.300011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:28.300011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:28.300011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:28.300011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:28.300011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:28.300011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:28.300011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:28.300011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:28.300011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:28.300011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:28.300011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:28.300011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:28.300011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:28.300850 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:41:28.300850 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:41:28.300850 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:28.300850 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:28.300850 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 243/494] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:28.301151 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f80fc1-295b-4794-9c11-f5ed07d29239 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:28.348703 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a44f4-b502-4982-b636-37d1c3f04962 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:28.381136 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5260c-873f-4c43-8720-c8f4ed918758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:28.381922 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5260c-873f-4c43-8720-c8f4ed918758 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:28.382199 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5260c-873f-4c43-8720-c8f4ed918758 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:28.382470 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5260c-873f-4c43-8720-c8f4ed918758 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:28.392006 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc5260c-873f-4c43-8720-c8f4ed918758 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:41:28.395987 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f80fc1-295b-4794-9c11-f5ed07d29239 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:28.400155 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-1dc5260c-873f-4c43-8720-c8f4ed918758 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:41:28.400155 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:28.400155 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:28.400155 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:28.400155 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:28.400155 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:28.400155 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:28.400155 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:28.400155 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:28.400155 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:28.400155 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:28.400155 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:28.400155 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:41:28.400155 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:41:28.400155 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:41:28.400155 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:41:28.401181 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:41:28.401181 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:41:28.401181 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:41:28.401181 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:41:28.401181 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:28.401181 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:28.401181 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:28.401181 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:28.401181 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:28.401181 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:28.401181 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:28.401181 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:28.401181 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:28.401181 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:28.401181 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:28.401181 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:28.401965 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:28.401965 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:28.401965 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:28.401965 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:28.401965 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:41:28.401965 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:41:28.401965 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:41:28.401965 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:41:28.401965 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:41:28.401965 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:41:28.401965 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:41:28.401965 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:28.401965 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 252/495] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Apr 30 20:41:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:28.402813 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5260c-873f-4c43-8720-c8f4ed918758 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:28.428999 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9f86c-f45a-4b81-b492-cd492ec0896e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:28.429641 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9f86c-f45a-4b81-b492-cd492ec0896e None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:28.429920 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9f86c-f45a-4b81-b492-cd492ec0896e None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:28.430194 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9f86c-f45a-4b81-b492-cd492ec0896e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:28.495131 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9f86c-f45a-4b81-b492-cd492ec0896e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:28.496495 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9f86c-f45a-4b81-b492-cd492ec0896e None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:28.501141 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5260c-873f-4c43-8720-c8f4ed918758 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:28.537244 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790bc36-503d-4b7b-9bba-d65b6e2babf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:28.538028 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790bc36-503d-4b7b-9bba-d65b6e2babf8 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:28.538307 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790bc36-503d-4b7b-9bba-d65b6e2babf8 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:28.538579 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790bc36-503d-4b7b-9bba-d65b6e2babf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:28.548942 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790bc36-503d-4b7b-9bba-d65b6e2babf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:28.550460 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790bc36-503d-4b7b-9bba-d65b6e2babf8 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:28.567692 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-1790bc36-503d-4b7b-9bba-d65b6e2babf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:28.567692 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:28.567692 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:28.567692 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:28.567692 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:28.567692 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:28.567692 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:28.567692 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:28.567692 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:28.567692 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:28.567692 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:28.567692 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:28.567692 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:41:28.567692 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:41:28.567692 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:41:28.568706 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:41:28.568706 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:28.568706 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:28.568706 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:28.568706 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:28.568706 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:28.568706 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:28.568706 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:28.568706 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:28.568706 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:28.568706 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:28.568706 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:28.568706 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:28.568706 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:28.568706 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:28.568706 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:28.568706 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:28.569678 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:41:28.569678 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:41:28.569678 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:28.569678 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:28.569678 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 253/496] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:28.570091 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790bc36-503d-4b7b-9bba-d65b6e2babf8 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:28.592388 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 244/497] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:41:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:41:28.593822 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9f86c-f45a-4b81-b492-cd492ec0896e None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:28.668869 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790bc36-503d-4b7b-9bba-d65b6e2babf8 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:28.688297 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9f86c-f45a-4b81-b492-cd492ec0896e None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:28.700802 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbda58f-968f-4c3f-8886-f829df9c6f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:28.701484 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbda58f-968f-4c3f-8886-f829df9c6f39 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:28.701768 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbda58f-968f-4c3f-8886-f829df9c6f39 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:28.702044 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbda58f-968f-4c3f-8886-f829df9c6f39 None admin] PATH_INFO: `/v3/domains` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:28.702752 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbda58f-968f-4c3f-8886-f829df9c6f39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:28.703060 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbda58f-968f-4c3f-8886-f829df9c6f39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:28.704460 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbda58f-968f-4c3f-8886-f829df9c6f39 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:28.715886 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 254/498] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:28.716673 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbda58f-968f-4c3f-8886-f829df9c6f39 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:28.720993 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658180e-1d11-4e32-9a65-81fff5b7c25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:28.721763 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658180e-1d11-4e32-9a65-81fff5b7c25f None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:28.722043 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658180e-1d11-4e32-9a65-81fff5b7c25f None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:28.722316 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658180e-1d11-4e32-9a65-81fff5b7c25f None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:28.723049 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658180e-1d11-4e32-9a65-81fff5b7c25f None admin] RBAC: Adding query filter params (name=service) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:28.723358 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658180e-1d11-4e32-9a65-81fff5b7c25f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:28.724730 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658180e-1d11-4e32-9a65-81fff5b7c25f None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:28.733010 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 245/499] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Apr 30 20:41:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:28.733635 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658180e-1d11-4e32-9a65-81fff5b7c25f None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:28.814744 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbda58f-968f-4c3f-8886-f829df9c6f39 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:28.827795 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658180e-1d11-4e32-9a65-81fff5b7c25f None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:28.845993 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359556d-0a6f-4876-a5a9-f5fe0a1a4d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:28.846656 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359556d-0a6f-4876-a5a9-f5fe0a1a4d31 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:28.846939 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359556d-0a6f-4876-a5a9-f5fe0a1a4d31 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:28.847212 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359556d-0a6f-4876-a5a9-f5fe0a1a4d31 None admin] PATH_INFO: `/v3/domains` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:28.847925 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359556d-0a6f-4876-a5a9-f5fe0a1a4d31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:28.848232 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359556d-0a6f-4876-a5a9-f5fe0a1a4d31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:28.849680 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359556d-0a6f-4876-a5a9-f5fe0a1a4d31 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:28.859673 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff596b97-7ee2-4846-8fd9-ff439f4b4166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:28.860454 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff596b97-7ee2-4846-8fd9-ff439f4b4166 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:28.860683 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 255/500] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:28.861350 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff596b97-7ee2-4846-8fd9-ff439f4b4166 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:28.861696 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff596b97-7ee2-4846-8fd9-ff439f4b4166 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:28.862011 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359556d-0a6f-4876-a5a9-f5fe0a1a4d31 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:28.872219 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff596b97-7ee2-4846-8fd9-ff439f4b4166 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:28.873704 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff596b97-7ee2-4846-8fd9-ff439f4b4166 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:28.890744 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-ff596b97-7ee2-4846-8fd9-ff439f4b4166 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:28.890744 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:28.890744 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:28.890744 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:28.890744 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:28.890744 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:28.890744 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:28.890744 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:28.890744 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:28.890744 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:28.890744 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:28.890744 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:28.890744 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:41:28.890744 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:41:28.890744 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:41:28.891751 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:41:28.891751 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:28.891751 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:28.891751 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:28.891751 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:28.891751 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:28.891751 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:28.891751 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:28.891751 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:28.891751 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:28.891751 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:28.891751 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:28.891751 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:28.891751 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:28.891751 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:28.891751 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:28.891751 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:28.893007 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:41:28.893007 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:41:28.893007 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:28.893007 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:28.893007 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 246/501] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:28.893007 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff596b97-7ee2-4846-8fd9-ff439f4b4166 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:28.956361 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359556d-0a6f-4876-a5a9-f5fe0a1a4d31 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:28.988533 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0782c80-1340-47b8-9b88-596e9d6ac4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:28.989355 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0782c80-1340-47b8-9b88-596e9d6ac4e6 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:28.989455 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff596b97-7ee2-4846-8fd9-ff439f4b4166 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:28.989638 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0782c80-1340-47b8-9b88-596e9d6ac4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:28.989912 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0782c80-1340-47b8-9b88-596e9d6ac4e6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:28.997184 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0782c80-1340-47b8-9b88-596e9d6ac4e6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:28.998647 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0782c80-1340-47b8-9b88-596e9d6ac4e6 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:29.015785 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-e0782c80-1340-47b8-9b88-596e9d6ac4e6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 30 20:41:29.015785 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:29.015785 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:29.015785 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:29.015785 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:29.015785 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:29.015785 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:29.015785 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:29.015785 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:29.015785 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:29.015785 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:29.015785 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:29.015785 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:41:29.015785 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:41:29.015785 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:41:29.015785 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:41:29.016723 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:29.016723 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:29.016723 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:41:29.016723 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:41:29.016723 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:41:29.016723 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:41:29.016723 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:29.016723 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:29.016723 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:29.016723 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:29.016723 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:29.016723 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:29.016723 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:29.016723 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:29.016723 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:29.016723 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:29.016723 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:29.016723 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:29.018370 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:29.018370 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:29.018370 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:41:29.018370 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:41:29.018370 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:41:29.018370 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:41:29.018370 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:41:29.018370 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:41:29.018370 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Apr 30 20:41:29.018370 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:29.018370 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 256/502] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:41:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:29.018370 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0782c80-1340-47b8-9b88-596e9d6ac4e6 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:29.024197 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a59ea0-a21f-45e7-895d-57f44b8d9331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:29.025099 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a59ea0-a21f-45e7-895d-57f44b8d9331 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:29.025382 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a59ea0-a21f-45e7-895d-57f44b8d9331 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:29.025655 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a59ea0-a21f-45e7-895d-57f44b8d9331 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:29.039087 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a59ea0-a21f-45e7-895d-57f44b8d9331 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:29.040556 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a59ea0-a21f-45e7-895d-57f44b8d9331 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:29.063508 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-90a59ea0-a21f-45e7-895d-57f44b8d9331 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:29.063508 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:29.063508 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:29.063508 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:29.063508 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:29.063508 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:29.063508 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:29.063508 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:29.063508 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:29.063508 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:29.063508 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:29.063508 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:29.063508 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:41:29.063508 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:41:29.063508 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:41:29.065435 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:41:29.065435 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:29.065435 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:29.065435 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:29.065435 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:29.065435 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:29.065435 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:29.065435 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:29.065435 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:29.065435 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:29.065435 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:29.065435 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:29.065435 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:29.065435 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:29.065435 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:29.065435 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:29.065435 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:29.066987 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:41:29.066987 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:41:29.066987 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:29.066987 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:29.066987 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 247/503] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:29.066987 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a59ea0-a21f-45e7-895d-57f44b8d9331 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:29.121044 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0782c80-1340-47b8-9b88-596e9d6ac4e6 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:29.153194 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb9453-16af-490e-8faa-6c7fb23b6cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:29.153981 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb9453-16af-490e-8faa-6c7fb23b6cd3 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:29.154259 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb9453-16af-490e-8faa-6c7fb23b6cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:29.154526 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb9453-16af-490e-8faa-6c7fb23b6cd3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:29.162057 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb9453-16af-490e-8faa-6c7fb23b6cd3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:29.163500 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb9453-16af-490e-8faa-6c7fb23b6cd3 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:29.166384 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a59ea0-a21f-45e7-895d-57f44b8d9331 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:29.177654 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-8cdb9453-16af-490e-8faa-6c7fb23b6cd3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 30 20:41:29.177654 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:29.177654 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:29.177654 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:29.177654 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:29.177654 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:29.177654 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:29.177654 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:29.177654 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:29.177654 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:29.177654 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:29.177654 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:29.177654 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:41:29.177654 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:41:29.177654 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:41:29.177654 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:41:29.178648 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:29.178648 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:29.178648 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:41:29.178648 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:41:29.178648 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:41:29.178648 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:41:29.178648 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:29.178648 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:29.178648 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:29.178648 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:29.178648 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:29.178648 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:29.178648 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:29.178648 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:29.178648 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:29.178648 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:29.178648 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:29.178648 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:29.179530 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:29.179530 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:29.179530 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:41:29.179530 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:41:29.179530 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:41:29.179530 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:41:29.179530 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:41:29.179530 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:41:29.179530 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Apr 30 20:41:29.179530 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:29.179530 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 257/504] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:41:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:29.180544 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb9453-16af-490e-8faa-6c7fb23b6cd3 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:29.206728 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d35159-b6e0-4273-b34a-bbfd254016e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:29.207396 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d35159-b6e0-4273-b34a-bbfd254016e5 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:29.207680 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d35159-b6e0-4273-b34a-bbfd254016e5 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:29.207951 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d35159-b6e0-4273-b34a-bbfd254016e5 None admin] PATH_INFO: `/v3/domains` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:29.208674 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d35159-b6e0-4273-b34a-bbfd254016e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:29.209021 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d35159-b6e0-4273-b34a-bbfd254016e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:29.210409 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d35159-b6e0-4273-b34a-bbfd254016e5 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:29.224504 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 248/505] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:41:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:29.225350 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d35159-b6e0-4273-b34a-bbfd254016e5 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:29.289351 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb9453-16af-490e-8faa-6c7fb23b6cd3 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:29.321438 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d35159-b6e0-4273-b34a-bbfd254016e5 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:29.327530 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec811d8-c703-4cf1-8750-b18e5713edda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:29.328200 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec811d8-c703-4cf1-8750-b18e5713edda None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:29.328477 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec811d8-c703-4cf1-8750-b18e5713edda None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:29.328746 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec811d8-c703-4cf1-8750-b18e5713edda None admin] PATH_INFO: `/v3/users` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:29.330310 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec811d8-c703-4cf1-8750-b18e5713edda None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:29.330604 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec811d8-c703-4cf1-8750-b18e5713edda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:29.332051 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec811d8-c703-4cf1-8750-b18e5713edda None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:29.359629 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80be0a-b97e-4db4-a910-7a8e4d04e606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:29.360292 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80be0a-b97e-4db4-a910-7a8e4d04e606 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:29.360573 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80be0a-b97e-4db4-a910-7a8e4d04e606 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:29.360926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80be0a-b97e-4db4-a910-7a8e4d04e606 None admin] PATH_INFO: `/v3/domains` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:29.361660 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80be0a-b97e-4db4-a910-7a8e4d04e606 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:29.361962 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80be0a-b97e-4db4-a910-7a8e4d04e606 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:29.363335 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80be0a-b97e-4db4-a910-7a8e4d04e606 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:29.369537 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 258/506] 10.222.0.26 () {56 vars in 1137 bytes} [Sat Apr 30 20:41:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:29.370384 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec811d8-c703-4cf1-8750-b18e5713edda None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:29.381310 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 249/507] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:41:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:29.381310 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80be0a-b97e-4db4-a910-7a8e4d04e606 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:29.471828 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec811d8-c703-4cf1-8750-b18e5713edda None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:29.481261 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80be0a-b97e-4db4-a910-7a8e4d04e606 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:29.505245 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef469e-74e4-4e21-a9a0-272c662bc2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:29.505913 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef469e-74e4-4e21-a9a0-272c662bc2df None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:29.506189 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef469e-74e4-4e21-a9a0-272c662bc2df None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:29.506470 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef469e-74e4-4e21-a9a0-272c662bc2df None admin] PATH_INFO: `/v3/users` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:29.507289 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef469e-74e4-4e21-a9a0-272c662bc2df None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:29.507592 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef469e-74e4-4e21-a9a0-272c662bc2df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:29.509063 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef469e-74e4-4e21-a9a0-272c662bc2df None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:29.517104 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b28053-8df3-4dac-816c-1cf41e2484ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:29.518392 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b28053-8df3-4dac-816c-1cf41e2484ea None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:29.518680 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b28053-8df3-4dac-816c-1cf41e2484ea None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:29.518953 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b28053-8df3-4dac-816c-1cf41e2484ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:29.526575 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b28053-8df3-4dac-816c-1cf41e2484ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:29.527145 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 259/508] 10.222.0.26 () {56 vars in 1137 bytes} [Sat Apr 30 20:41:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:29.527963 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef469e-74e4-4e21-a9a0-272c662bc2df None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:29.528357 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b28053-8df3-4dac-816c-1cf41e2484ea None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:29.544250 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-d0b28053-8df3-4dac-816c-1cf41e2484ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:41:29.544250 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:29.544250 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:29.544250 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:29.544250 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:29.544250 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:29.544250 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:29.544250 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:29.544250 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:29.544250 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:29.544250 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:29.544250 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:29.544250 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:41:29.544250 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:41:29.544250 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:41:29.545199 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:41:29.545199 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:29.545199 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:29.545199 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:29.545199 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:29.545199 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:29.545199 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:29.545199 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:29.545199 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:29.545199 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:29.545199 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:29.545199 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:29.545199 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:29.545199 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:29.545199 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:29.545199 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:29.545199 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:29.546050 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:41:29.546050 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:41:29.546050 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:41:29.546050 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:41:29.546050 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:41:29.546050 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:41:29.546050 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:41:29.546050 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:29.546050 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 250/509] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:41:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:29.546536 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b28053-8df3-4dac-816c-1cf41e2484ea None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:29.640475 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef469e-74e4-4e21-a9a0-272c662bc2df None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:29.648194 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b28053-8df3-4dac-816c-1cf41e2484ea None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:29.677581 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b23ce-fef5-42e2-9f64-f5e36fcb6f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:29.678239 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b23ce-fef5-42e2-9f64-f5e36fcb6f20 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:29.678524 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b23ce-fef5-42e2-9f64-f5e36fcb6f20 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:29.678800 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b23ce-fef5-42e2-9f64-f5e36fcb6f20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:29.683740 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a9714-dee9-41fa-ab29-71aa33d1ae33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:29.684533 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a9714-dee9-41fa-ab29-71aa33d1ae33 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:29.686652 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a9714-dee9-41fa-ab29-71aa33d1ae33 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:29.686652 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a9714-dee9-41fa-ab29-71aa33d1ae33 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:29.693405 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a9714-dee9-41fa-ab29-71aa33d1ae33 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:29.694921 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a9714-dee9-41fa-ab29-71aa33d1ae33 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:29.712817 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-c38a9714-dee9-41fa-ab29-71aa33d1ae33 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 30 20:41:29.712817 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:29.712817 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:29.712817 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:29.712817 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:29.712817 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:29.712817 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:29.712817 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:29.712817 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:29.712817 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:29.712817 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:29.712817 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:29.712817 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:41:29.712817 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:41:29.712817 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:41:29.712817 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:41:29.713926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:29.713926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:29.713926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:41:29.713926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:41:29.713926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:41:29.713926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:41:29.713926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:29.713926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:29.713926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:29.713926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:29.713926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:29.713926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:29.713926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:29.713926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:29.713926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:29.713926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:29.713926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:29.713926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:29.714996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:29.714996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:29.714996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:41:29.714996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:41:29.714996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:41:29.714996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:41:29.714996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:41:29.714996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:41:29.714996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Apr 30 20:41:29.714996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:29.714996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 251/510] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Apr 30 20:41:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:29.716274 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a9714-dee9-41fa-ab29-71aa33d1ae33 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:29.752936 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b23ce-fef5-42e2-9f64-f5e36fcb6f20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:29.755154 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b23ce-fef5-42e2-9f64-f5e36fcb6f20 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:29.822161 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a9714-dee9-41fa-ab29-71aa33d1ae33 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:29.855853 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dce6b7-0c39-4ac6-84d6-d5eafc757106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:29.856615 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dce6b7-0c39-4ac6-84d6-d5eafc757106 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:29.856950 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dce6b7-0c39-4ac6-84d6-d5eafc757106 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:29.857188 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dce6b7-0c39-4ac6-84d6-d5eafc757106 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:29.860140 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 260/511] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:41:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:41:29.861525 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b23ce-fef5-42e2-9f64-f5e36fcb6f20 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:29.929340 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dce6b7-0c39-4ac6-84d6-d5eafc757106 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:29.930716 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dce6b7-0c39-4ac6-84d6-d5eafc757106 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:29.968095 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b23ce-fef5-42e2-9f64-f5e36fcb6f20 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:30.008685 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412473f9-e81a-43bb-9d99-d8416a232e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:30.009369 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412473f9-e81a-43bb-9d99-d8416a232e3c None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:30.009657 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412473f9-e81a-43bb-9d99-d8416a232e3c None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:30.009931 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412473f9-e81a-43bb-9d99-d8416a232e3c None admin] PATH_INFO: `/v3/projects` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:30.010705 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412473f9-e81a-43bb-9d99-d8416a232e3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:30.011017 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412473f9-e81a-43bb-9d99-d8416a232e3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:30.012467 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412473f9-e81a-43bb-9d99-d8416a232e3c None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:30.028070 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 252/512] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:41:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:41:30.028932 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dce6b7-0c39-4ac6-84d6-d5eafc757106 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:30.036403 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 261/513] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Apr 30 20:41:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:30.036403 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412473f9-e81a-43bb-9d99-d8416a232e3c None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:30.127938 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dce6b7-0c39-4ac6-84d6-d5eafc757106 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:30.130779 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412473f9-e81a-43bb-9d99-d8416a232e3c None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:30.160571 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3d44b-9a8b-4e26-aa4f-1a26c9786c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:30.161262 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3d44b-9a8b-4e26-aa4f-1a26c9786c6a None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:30.161543 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3d44b-9a8b-4e26-aa4f-1a26c9786c6a None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:30.161810 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3d44b-9a8b-4e26-aa4f-1a26c9786c6a None admin] PATH_INFO: `/v3/users` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:30.162632 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c3d44b-9a8b-4e26-aa4f-1a26c9786c6a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:30.162941 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c3d44b-9a8b-4e26-aa4f-1a26c9786c6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:30.163376 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73328b1e-4b32-438f-a8eb-c822d97be206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:30.164159 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73328b1e-4b32-438f-a8eb-c822d97be206 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:30.164371 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c3d44b-9a8b-4e26-aa4f-1a26c9786c6a None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:30.164457 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73328b1e-4b32-438f-a8eb-c822d97be206 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:30.164694 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73328b1e-4b32-438f-a8eb-c822d97be206 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:30.175023 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73328b1e-4b32-438f-a8eb-c822d97be206 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:30.176475 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73328b1e-4b32-438f-a8eb-c822d97be206 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:30.181503 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 253/514] 10.222.0.26 () {56 vars in 1139 bytes} [Sat Apr 30 20:41:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:30.182245 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3d44b-9a8b-4e26-aa4f-1a26c9786c6a None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:30.194333 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-73328b1e-4b32-438f-a8eb-c822d97be206 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:30.194333 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:30.194333 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:30.194333 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:30.194333 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:30.194333 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:30.194333 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:30.194333 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:30.194333 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:30.194333 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:30.194333 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:30.194333 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:30.194333 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:41:30.194333 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:41:30.194333 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:41:30.195207 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:41:30.195207 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:30.195207 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:30.195207 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:30.195207 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:30.195207 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:30.195207 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:30.195207 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:30.195207 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:30.195207 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:30.195207 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:30.195207 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:30.195207 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:30.195207 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:30.195207 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:30.195207 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:30.195207 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:30.196130 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:41:30.196130 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:41:30.196130 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:30.196130 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:30.196130 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 262/515] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:30.196382 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73328b1e-4b32-438f-a8eb-c822d97be206 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:30.278074 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3d44b-9a8b-4e26-aa4f-1a26c9786c6a None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:30.292218 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73328b1e-4b32-438f-a8eb-c822d97be206 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:30.310451 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f34e7-a3c0-4d19-a160-2760d080a1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:30.311101 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f34e7-a3c0-4d19-a160-2760d080a1d7 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:30.311382 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f34e7-a3c0-4d19-a160-2760d080a1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:30.311658 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f34e7-a3c0-4d19-a160-2760d080a1d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:30.312474 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f34e7-a3c0-4d19-a160-2760d080a1d7 None admin] RBAC: Adding query filter params (role.id=65db0aa5d0b04764ab538efe5f356652, scope.project.id=45ddbc3ac9ff421598cbe53e1252d289, user.id=2aee3a7a6b4b4d489993c131f3ae2048) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:30.312783 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f34e7-a3c0-4d19-a160-2760d080a1d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:30.314475 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f34e7-a3c0-4d19-a160-2760d080a1d7 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:30.319891 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 254/516] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Apr 30 20:41:30 2022] GET /identity/v3/role_assignments?user.id=2aee3a7a6b4b4d489993c131f3ae2048&scope.project.id=45ddbc3ac9ff421598cbe53e1252d289&role.id=65db0aa5d0b04764ab538efe5f356652 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:30.320569 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f34e7-a3c0-4d19-a160-2760d080a1d7 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:30.334335 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689eb74-116f-455e-ac84-8aee2d5d6580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:30.335152 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689eb74-116f-455e-ac84-8aee2d5d6580 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:30.335436 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689eb74-116f-455e-ac84-8aee2d5d6580 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:30.335710 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689eb74-116f-455e-ac84-8aee2d5d6580 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:30.349226 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689eb74-116f-455e-ac84-8aee2d5d6580 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:30.351017 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689eb74-116f-455e-ac84-8aee2d5d6580 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:30.369182 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-1689eb74-116f-455e-ac84-8aee2d5d6580 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:30.369182 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:30.369182 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:30.369182 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:30.369182 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:30.369182 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:30.369182 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:30.369182 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:30.369182 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:30.369182 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:30.369182 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:30.369182 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:30.369182 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:41:30.369182 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:41:30.369182 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:41:30.370121 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:41:30.370121 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:30.370121 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:30.370121 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:30.370121 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:30.370121 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:30.370121 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:30.370121 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:30.370121 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:30.370121 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:30.370121 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:30.370121 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:30.370121 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:30.370121 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:30.370121 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:30.370121 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:30.370121 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:30.376075 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:41:30.376075 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:41:30.376075 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:30.376075 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:30.376075 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 263/517] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:30.376075 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689eb74-116f-455e-ac84-8aee2d5d6580 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:30.428605 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f34e7-a3c0-4d19-a160-2760d080a1d7 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:30.464165 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ec625-7104-4d2c-b202-ae8dbf38f850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:30.464799 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ec625-7104-4d2c-b202-ae8dbf38f850 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:30.465115 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ec625-7104-4d2c-b202-ae8dbf38f850 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:30.465391 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ec625-7104-4d2c-b202-ae8dbf38f850 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:30.477720 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689eb74-116f-455e-ac84-8aee2d5d6580 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:30.514470 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f6e18-af06-4808-aefe-d0b4cce1a93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:30.515522 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f6e18-af06-4808-aefe-d0b4cce1a93f None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:30.515522 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f6e18-af06-4808-aefe-d0b4cce1a93f None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:30.515714 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f6e18-af06-4808-aefe-d0b4cce1a93f None admin] PATH_INFO: `/v3/domains` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:30.516385 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f6e18-af06-4808-aefe-d0b4cce1a93f None admin] RBAC: Adding query filter params (name=Default) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:30.516691 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f6e18-af06-4808-aefe-d0b4cce1a93f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:30.518712 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f6e18-af06-4808-aefe-d0b4cce1a93f None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:30.530645 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 264/518] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:30.531472 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f6e18-af06-4808-aefe-d0b4cce1a93f None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:30.544150 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ec625-7104-4d2c-b202-ae8dbf38f850 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:30.545655 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ec625-7104-4d2c-b202-ae8dbf38f850 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:30.635860 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f6e18-af06-4808-aefe-d0b4cce1a93f None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:30.645227 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 255/519] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:41:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:41:30.645227 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ec625-7104-4d2c-b202-ae8dbf38f850 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:30.671014 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713499a-d4a7-4a6c-81c0-fd10db1088d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:30.671956 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713499a-d4a7-4a6c-81c0-fd10db1088d9 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:30.672237 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713499a-d4a7-4a6c-81c0-fd10db1088d9 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:30.672515 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713499a-d4a7-4a6c-81c0-fd10db1088d9 None admin] PATH_INFO: `/v3/domains` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:30.673276 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713499a-d4a7-4a6c-81c0-fd10db1088d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:30.674174 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713499a-d4a7-4a6c-81c0-fd10db1088d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:30.675578 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713499a-d4a7-4a6c-81c0-fd10db1088d9 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:30.686998 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 265/520] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:30.687818 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713499a-d4a7-4a6c-81c0-fd10db1088d9 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:30.739221 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ec625-7104-4d2c-b202-ae8dbf38f850 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:30.771946 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d089ac-34eb-413e-843c-dfa1f70c8a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:30.772858 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d089ac-34eb-413e-843c-dfa1f70c8a9d None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:30.773315 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d089ac-34eb-413e-843c-dfa1f70c8a9d None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:30.773657 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d089ac-34eb-413e-843c-dfa1f70c8a9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:30.780209 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d089ac-34eb-413e-843c-dfa1f70c8a9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:30.781793 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d089ac-34eb-413e-843c-dfa1f70c8a9d None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:30.791264 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713499a-d4a7-4a6c-81c0-fd10db1088d9 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:30.795934 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-51d089ac-34eb-413e-843c-dfa1f70c8a9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:41:30.795934 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:30.795934 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:30.795934 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:30.795934 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:30.795934 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:30.795934 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:30.795934 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:30.795934 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:30.795934 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:30.795934 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:30.795934 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:30.795934 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:41:30.795934 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:41:30.795934 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:41:30.796962 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:41:30.796962 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:30.796962 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:30.796962 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:30.796962 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:30.796962 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:30.796962 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:30.796962 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:30.796962 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:30.796962 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:30.796962 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:30.796962 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:30.796962 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:30.796962 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:30.796962 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:30.796962 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:30.796962 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:30.798013 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:41:30.798013 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:41:30.798013 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:41:30.798013 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:41:30.798013 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:41:30.798013 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:41:30.798013 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:41:30.798013 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:30.800431 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 256/521] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:41:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:30.801108 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d089ac-34eb-413e-843c-dfa1f70c8a9d None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:30.829951 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112ef56-eae8-4990-99d4-c9d60e361810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:30.830898 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112ef56-eae8-4990-99d4-c9d60e361810 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:30.831199 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112ef56-eae8-4990-99d4-c9d60e361810 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:30.831464 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112ef56-eae8-4990-99d4-c9d60e361810 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:30.841894 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112ef56-eae8-4990-99d4-c9d60e361810 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:30.843351 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112ef56-eae8-4990-99d4-c9d60e361810 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:30.861847 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-c112ef56-eae8-4990-99d4-c9d60e361810 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:30.861847 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:30.861847 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:30.861847 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:30.861847 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:30.861847 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:30.861847 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:30.861847 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:30.861847 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:30.861847 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:30.861847 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:30.861847 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:30.861847 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:41:30.861847 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:41:30.861847 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:41:30.863253 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:41:30.863253 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:30.863253 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:30.863253 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:30.863253 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:30.863253 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:30.863253 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:30.863253 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:30.863253 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:30.863253 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:30.863253 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:30.863253 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:30.863253 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:30.863253 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:30.863253 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:30.863253 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:30.863253 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:30.864534 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:41:30.864534 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:41:30.864534 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:30.864534 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:30.864534 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 266/522] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:30.865011 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112ef56-eae8-4990-99d4-c9d60e361810 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:30.912556 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d089ac-34eb-413e-843c-dfa1f70c8a9d None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:30.946005 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920168d5-5f47-46d4-8edb-33ca550ff42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:30.947123 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920168d5-5f47-46d4-8edb-33ca550ff42a None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:30.947405 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920168d5-5f47-46d4-8edb-33ca550ff42a None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:30.947678 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920168d5-5f47-46d4-8edb-33ca550ff42a None admin] PATH_INFO: `/v3/projects/service` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:30.954406 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920168d5-5f47-46d4-8edb-33ca550ff42a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:30.956881 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920168d5-5f47-46d4-8edb-33ca550ff42a None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:30.960660 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112ef56-eae8-4990-99d4-c9d60e361810 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:30.971192 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-920168d5-5f47-46d4-8edb-33ca550ff42a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:41:30.971192 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:30.971192 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:30.971192 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:30.971192 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:30.971192 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:30.971192 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:30.971192 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:30.971192 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:30.971192 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:30.971192 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:30.971192 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:30.971192 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:41:30.971192 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:41:30.971192 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:41:30.972041 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:41:30.972041 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:30.972041 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:30.972041 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:30.972041 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:30.972041 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:30.972041 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:30.972041 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:30.972041 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:30.972041 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:30.972041 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:30.972041 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:30.972041 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:30.972041 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:30.972041 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:30.972041 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:30.972041 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:30.972861 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:41:30.972861 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:41:30.972861 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:41:30.972861 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:41:30.972861 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:41:30.972861 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:41:30.972861 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:41:30.972861 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:30.972861 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 257/523] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:41:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:30.973354 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920168d5-5f47-46d4-8edb-33ca550ff42a None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:30.993321 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3eac16-f181-4f0b-b044-2c9fa8283f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:30.993919 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3eac16-f181-4f0b-b044-2c9fa8283f2f None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:30.994207 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3eac16-f181-4f0b-b044-2c9fa8283f2f None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:30.994486 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3eac16-f181-4f0b-b044-2c9fa8283f2f None admin] PATH_INFO: `/v3/projects` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:30.995262 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3eac16-f181-4f0b-b044-2c9fa8283f2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:30.995571 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3eac16-f181-4f0b-b044-2c9fa8283f2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:30.997066 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3eac16-f181-4f0b-b044-2c9fa8283f2f None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:31.014226 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 267/524] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Apr 30 20:41:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:31.014226 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3eac16-f181-4f0b-b044-2c9fa8283f2f None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:31.081158 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920168d5-5f47-46d4-8edb-33ca550ff42a None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:31.108211 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3eac16-f181-4f0b-b044-2c9fa8283f2f None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:31.114585 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f75def-fe2e-41a1-8597-1de0a5e06396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:31.115244 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f75def-fe2e-41a1-8597-1de0a5e06396 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:31.115521 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f75def-fe2e-41a1-8597-1de0a5e06396 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:31.115793 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f75def-fe2e-41a1-8597-1de0a5e06396 None admin] PATH_INFO: `/v3/domains` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:31.116496 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f75def-fe2e-41a1-8597-1de0a5e06396 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:31.116798 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f75def-fe2e-41a1-8597-1de0a5e06396 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:31.118197 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f75def-fe2e-41a1-8597-1de0a5e06396 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:31.134501 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 258/525] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:31.134501 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f75def-fe2e-41a1-8597-1de0a5e06396 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:31.148585 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08f972-78f8-41bf-b7a9-a05d9fdeb6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:31.149281 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08f972-78f8-41bf-b7a9-a05d9fdeb6f0 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:31.149568 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08f972-78f8-41bf-b7a9-a05d9fdeb6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:31.149845 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08f972-78f8-41bf-b7a9-a05d9fdeb6f0 None admin] PATH_INFO: `/v3/projects` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:31.150643 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08f972-78f8-41bf-b7a9-a05d9fdeb6f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:31.150971 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08f972-78f8-41bf-b7a9-a05d9fdeb6f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:31.152430 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08f972-78f8-41bf-b7a9-a05d9fdeb6f0 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:31.164534 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 268/526] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Apr 30 20:41:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:31.165644 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08f972-78f8-41bf-b7a9-a05d9fdeb6f0 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:31.239365 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f75def-fe2e-41a1-8597-1de0a5e06396 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:31.269046 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08f972-78f8-41bf-b7a9-a05d9fdeb6f0 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:31.272654 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02177324-7a26-42f9-bd7a-fa643201a346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:31.273340 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02177324-7a26-42f9-bd7a-fa643201a346 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:31.273622 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02177324-7a26-42f9-bd7a-fa643201a346 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:31.273899 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02177324-7a26-42f9-bd7a-fa643201a346 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:31.274727 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02177324-7a26-42f9-bd7a-fa643201a346 None admin] RBAC: Adding query filter params (role.id=65db0aa5d0b04764ab538efe5f356652, scope.project.id=45ddbc3ac9ff421598cbe53e1252d289, user.id=43ed44bbd52047cbbcab1bc72d650b8e) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:31.275041 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02177324-7a26-42f9-bd7a-fa643201a346 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:31.276476 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02177324-7a26-42f9-bd7a-fa643201a346 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:31.282254 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 259/527] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Apr 30 20:41:31 2022] GET /identity/v3/role_assignments?user.id=43ed44bbd52047cbbcab1bc72d650b8e&scope.project.id=45ddbc3ac9ff421598cbe53e1252d289&role.id=65db0aa5d0b04764ab538efe5f356652 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:31.288997 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02177324-7a26-42f9-bd7a-fa643201a346 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:31.304439 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61960fca-3515-4fe9-9940-466597a39062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:31.305333 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61960fca-3515-4fe9-9940-466597a39062 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:31.305615 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61960fca-3515-4fe9-9940-466597a39062 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:31.305891 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61960fca-3515-4fe9-9940-466597a39062 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:31.314791 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61960fca-3515-4fe9-9940-466597a39062 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:31.316311 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61960fca-3515-4fe9-9940-466597a39062 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:31.333743 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-61960fca-3515-4fe9-9940-466597a39062 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:41:31.333743 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:31.333743 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:31.333743 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:31.333743 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:31.333743 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:31.333743 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:31.333743 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:31.333743 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:31.333743 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:31.333743 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:31.333743 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:31.333743 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:41:31.333743 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:41:31.333743 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:41:31.334658 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:41:31.334658 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:31.334658 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:31.334658 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:31.334658 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:31.334658 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:31.334658 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:31.334658 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:31.334658 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:31.334658 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:31.334658 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:31.334658 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:31.334658 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:31.334658 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:31.334658 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:31.334658 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:31.334658 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:31.335486 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:41:31.335486 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:41:31.335486 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:41:31.335486 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:41:31.335486 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:41:31.335486 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:41:31.335486 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:41:31.335486 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:31.335486 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 269/528] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:41:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:31.341478 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61960fca-3515-4fe9-9940-466597a39062 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:31.414990 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02177324-7a26-42f9-bd7a-fa643201a346 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:31.456864 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef980d-170a-4993-9701-46872f4e679d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:31.457734 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef980d-170a-4993-9701-46872f4e679d None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:31.458148 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef980d-170a-4993-9701-46872f4e679d None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:31.458533 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef980d-170a-4993-9701-46872f4e679d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:31.459490 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef980d-170a-4993-9701-46872f4e679d None admin] RBAC: Adding query filter params (role.id=65db0aa5d0b04764ab538efe5f356652, scope.project.id=45ddbc3ac9ff421598cbe53e1252d289, user.id=ec3374e008274f9eb4476b9f6a528fa6) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:31.459916 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef980d-170a-4993-9701-46872f4e679d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:31.461549 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef980d-170a-4993-9701-46872f4e679d None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:31.467728 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 260/529] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Apr 30 20:41:31 2022] GET /identity/v3/role_assignments?user.id=ec3374e008274f9eb4476b9f6a528fa6&scope.project.id=45ddbc3ac9ff421598cbe53e1252d289&role.id=65db0aa5d0b04764ab538efe5f356652 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:31.475558 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61960fca-3515-4fe9-9940-466597a39062 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:31.515746 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b29a8-e98a-4463-9356-c479b72cd5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:31.516721 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b29a8-e98a-4463-9356-c479b72cd5b5 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:31.517931 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b29a8-e98a-4463-9356-c479b72cd5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:31.518623 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b29a8-e98a-4463-9356-c479b72cd5b5 None admin] PATH_INFO: `/v3/projects` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:31.519691 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b29a8-e98a-4463-9356-c479b72cd5b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:31.520210 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b29a8-e98a-4463-9356-c479b72cd5b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:31.521920 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b29a8-e98a-4463-9356-c479b72cd5b5 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:31.537052 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 270/530] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Apr 30 20:41:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:31.546258 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef980d-170a-4993-9701-46872f4e679d None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:31.653683 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef980d-170a-4993-9701-46872f4e679d None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:31.688574 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284f3f1-38ad-46ef-bd08-ed66406c7527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:31.689779 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284f3f1-38ad-46ef-bd08-ed66406c7527 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:31.690064 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284f3f1-38ad-46ef-bd08-ed66406c7527 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:31.690340 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284f3f1-38ad-46ef-bd08-ed66406c7527 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:31.691166 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b284f3f1-38ad-46ef-bd08-ed66406c7527 None admin] RBAC: Adding query filter params (role.id=65db0aa5d0b04764ab538efe5f356652, scope.project.id=45ddbc3ac9ff421598cbe53e1252d289, user.id=9918e808c77e4017a64c96ad24164b37) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:31.691478 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b284f3f1-38ad-46ef-bd08-ed66406c7527 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:31.692917 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b284f3f1-38ad-46ef-bd08-ed66406c7527 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:31.698890 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 261/531] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Apr 30 20:41:31 2022] GET /identity/v3/role_assignments?user.id=9918e808c77e4017a64c96ad24164b37&scope.project.id=45ddbc3ac9ff421598cbe53e1252d289&role.id=65db0aa5d0b04764ab538efe5f356652 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:32.695799 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28836a-1fe1-4b00-8e29-86dae80e2892 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:32.696364 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28836a-1fe1-4b00-8e29-86dae80e2892 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:32.696364 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28836a-1fe1-4b00-8e29-86dae80e2892 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:32.697956 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 271/532] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:32.703461 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3ffaf-d812-4824-811e-092cf55f24aa None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:32.703865 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3ffaf-d812-4824-811e-092cf55f24aa None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:32.704052 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3ffaf-d812-4824-811e-092cf55f24aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:32.722054 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-74a3ffaf-d812-4824-811e-092cf55f24aa None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:32.723235 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-74a3ffaf-d812-4824-811e-092cf55f24aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:32.790935 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 262/533] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:41:32.824695 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28836a-1fe1-4b00-8e29-86dae80e2892 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:32.930429 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28836a-1fe1-4b00-8e29-86dae80e2892 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:32.964601 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44523663-fd4b-4d08-9c7b-3675f8dd03a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:32.965341 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44523663-fd4b-4d08-9c7b-3675f8dd03a9 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:32.965622 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44523663-fd4b-4d08-9c7b-3675f8dd03a9 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:32.965895 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44523663-fd4b-4d08-9c7b-3675f8dd03a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:32.976225 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44523663-fd4b-4d08-9c7b-3675f8dd03a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:41:32.983685 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-44523663-fd4b-4d08-9c7b-3675f8dd03a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:41:32.983685 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:32.983685 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:32.983685 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:32.983685 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:32.983685 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:32.983685 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:32.983685 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:32.983685 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:32.983685 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:32.983685 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:32.983685 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:32.983685 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:41:32.983685 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:41:32.983685 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:41:32.983685 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:41:32.984687 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:41:32.984687 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:41:32.984687 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:41:32.984687 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:41:32.984687 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:32.984687 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:32.984687 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:32.984687 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:32.984687 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:32.984687 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:32.984687 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:32.984687 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:32.984687 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:32.984687 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:32.984687 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:32.984687 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:32.985508 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:32.985508 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:32.985508 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:32.985508 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:32.985508 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:41:32.985508 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:41:32.985508 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:41:32.985508 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:41:32.985508 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:41:32.985508 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:41:32.985508 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:41:32.985508 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:32.985508 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 272/534] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Apr 30 20:41:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:32.991329 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3ffaf-d812-4824-811e-092cf55f24aa None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:33.090954 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3ffaf-d812-4824-811e-092cf55f24aa None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:33.125313 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca7035-fe53-4b2c-847a-3e678c3e9e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:33.125979 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca7035-fe53-4b2c-847a-3e678c3e9e33 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:33.126257 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca7035-fe53-4b2c-847a-3e678c3e9e33 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:33.127109 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca7035-fe53-4b2c-847a-3e678c3e9e33 None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:33.127842 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca7035-fe53-4b2c-847a-3e678c3e9e33 None admin] RBAC: Adding query filter params (name=service) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:33.128144 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca7035-fe53-4b2c-847a-3e678c3e9e33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:33.129529 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca7035-fe53-4b2c-847a-3e678c3e9e33 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:33.138087 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 263/535] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Apr 30 20:41:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:33.144281 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44523663-fd4b-4d08-9c7b-3675f8dd03a9 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:33.244557 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44523663-fd4b-4d08-9c7b-3675f8dd03a9 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:33.279068 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc8163-1e7c-4f0d-aa34-f69c2b70f4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:33.279859 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc8163-1e7c-4f0d-aa34-f69c2b70f4a2 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:33.280138 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc8163-1e7c-4f0d-aa34-f69c2b70f4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:33.280410 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc8163-1e7c-4f0d-aa34-f69c2b70f4a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:33.291496 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc8163-1e7c-4f0d-aa34-f69c2b70f4a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:33.292989 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc8163-1e7c-4f0d-aa34-f69c2b70f4a2 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:33.310963 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-06cc8163-1e7c-4f0d-aa34-f69c2b70f4a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:33.310963 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:33.310963 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:33.310963 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:33.310963 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:33.310963 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:33.310963 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:33.310963 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:33.310963 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:33.310963 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:33.310963 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:33.310963 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:33.310963 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:41:33.310963 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:41:33.310963 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:41:33.311927 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:41:33.311927 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:33.311927 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:33.311927 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:33.311927 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:33.311927 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:33.311927 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:33.311927 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:33.311927 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:33.311927 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:33.311927 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:33.311927 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:33.311927 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:33.311927 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:33.311927 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:33.311927 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:33.311927 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:33.313345 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:41:33.313345 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:41:33.313345 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:33.313345 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:33.313345 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 273/536] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:33.318392 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca7035-fe53-4b2c-847a-3e678c3e9e33 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:33.420345 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca7035-fe53-4b2c-847a-3e678c3e9e33 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:33.455705 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aca89e-0b12-4f20-82b7-51a066ab0544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:33.457086 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aca89e-0b12-4f20-82b7-51a066ab0544 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:33.457086 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aca89e-0b12-4f20-82b7-51a066ab0544 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:33.457086 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aca89e-0b12-4f20-82b7-51a066ab0544 None admin] PATH_INFO: `/v3/domains` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:33.457627 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aca89e-0b12-4f20-82b7-51a066ab0544 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:33.457935 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aca89e-0b12-4f20-82b7-51a066ab0544 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:33.459378 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aca89e-0b12-4f20-82b7-51a066ab0544 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:33.471949 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 264/537] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:33.477707 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc8163-1e7c-4f0d-aa34-f69c2b70f4a2 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:33.586570 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc8163-1e7c-4f0d-aa34-f69c2b70f4a2 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:33.621623 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119eba0a-b210-46be-83d8-4d8b6bdb9469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:33.622458 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119eba0a-b210-46be-83d8-4d8b6bdb9469 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:33.622743 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119eba0a-b210-46be-83d8-4d8b6bdb9469 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:33.623019 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119eba0a-b210-46be-83d8-4d8b6bdb9469 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:33.631888 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119eba0a-b210-46be-83d8-4d8b6bdb9469 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:33.633387 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119eba0a-b210-46be-83d8-4d8b6bdb9469 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:33.648382 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-119eba0a-b210-46be-83d8-4d8b6bdb9469 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 30 20:41:33.648382 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:33.648382 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:33.648382 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:33.648382 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:33.648382 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:33.648382 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:33.648382 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:33.648382 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:33.648382 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:33.648382 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:33.648382 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:33.648382 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:41:33.648382 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:41:33.648382 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:41:33.648382 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:41:33.650509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:33.650509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:33.650509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:41:33.650509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:41:33.650509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:41:33.650509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:41:33.650509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:33.650509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:33.650509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:33.650509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:33.650509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:33.650509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:33.650509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:33.650509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:33.650509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:33.650509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:33.650509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:33.650509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:33.652696 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:33.652696 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:33.652696 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:41:33.652696 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:41:33.652696 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:41:33.652696 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:41:33.652696 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:41:33.652696 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:41:33.652696 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Apr 30 20:41:33.652696 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:33.652696 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 274/538] 10.222.0.26 () {56 vars in 1093 bytes} [Sat Apr 30 20:41:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:33.655657 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aca89e-0b12-4f20-82b7-51a066ab0544 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:33.739336 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b023e-6144-4661-bfd1-5eae68593ae8 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:33.740321 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b023e-6144-4661-bfd1-5eae68593ae8 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:33.740797 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b023e-6144-4661-bfd1-5eae68593ae8 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:33.742676 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 275/539] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:33.748227 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada263e2-fdcd-4c60-a933-29bd2b0752ca None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:33.748513 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada263e2-fdcd-4c60-a933-29bd2b0752ca None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:33.748789 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada263e2-fdcd-4c60-a933-29bd2b0752ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:33.765170 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aca89e-0b12-4f20-82b7-51a066ab0544 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:33.766689 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-ada263e2-fdcd-4c60-a933-29bd2b0752ca None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:33.768041 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-ada263e2-fdcd-4c60-a933-29bd2b0752ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:33.802505 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef95b0-4bca-4fcb-bed8-5a53220ac9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:33.803624 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef95b0-4bca-4fcb-bed8-5a53220ac9d7 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:33.804194 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef95b0-4bca-4fcb-bed8-5a53220ac9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:33.804664 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef95b0-4bca-4fcb-bed8-5a53220ac9d7 None admin] PATH_INFO: `/v3/users` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:33.805722 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef95b0-4bca-4fcb-bed8-5a53220ac9d7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:33.806234 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef95b0-4bca-4fcb-bed8-5a53220ac9d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:33.819211 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef95b0-4bca-4fcb-bed8-5a53220ac9d7 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:33.844327 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 265/540] 10.222.0.26 () {56 vars in 1133 bytes} [Sat Apr 30 20:41:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:41:33.846886 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef95b0-4bca-4fcb-bed8-5a53220ac9d7 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:33.853195 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 276/541] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:41:33.872444 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada263e2-fdcd-4c60-a933-29bd2b0752ca None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:33.949513 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef95b0-4bca-4fcb-bed8-5a53220ac9d7 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:33.975451 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada263e2-fdcd-4c60-a933-29bd2b0752ca None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:33.984560 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f1c84-e3cd-4d0b-b789-501232ccb5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:33.985549 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f1c84-e3cd-4d0b-b789-501232ccb5a7 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:33.985732 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f1c84-e3cd-4d0b-b789-501232ccb5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:33.986030 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f1c84-e3cd-4d0b-b789-501232ccb5a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:33.996206 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f1c84-e3cd-4d0b-b789-501232ccb5a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:33.997686 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f1c84-e3cd-4d0b-b789-501232ccb5a7 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:34.012012 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee4332-ecc7-4f26-9d86-b8555de9025b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:34.012814 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee4332-ecc7-4f26-9d86-b8555de9025b None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:34.013130 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee4332-ecc7-4f26-9d86-b8555de9025b None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:34.013402 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee4332-ecc7-4f26-9d86-b8555de9025b None admin] PATH_INFO: `/v3/roles/service` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:34.019654 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-da6f1c84-e3cd-4d0b-b789-501232ccb5a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:34.019654 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:34.019654 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:34.019654 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:34.019654 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:34.019654 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:34.019654 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:34.019654 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:34.019654 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:34.019654 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:34.019654 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:34.019654 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:34.019654 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:41:34.019654 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:41:34.019654 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:41:34.020612 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:41:34.020612 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:34.020612 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:34.020612 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:34.020612 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:34.020612 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:34.020612 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:34.020612 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:34.020612 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:34.020612 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:34.020612 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:34.020612 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:34.020612 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:34.020612 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:34.020612 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:34.020612 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:34.020612 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:34.021485 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:41:34.021485 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:41:34.021485 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:34.021485 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:34.021485 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 266/542] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:41:34.022498 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cfb2c-9d1c-40bf-9c72-e386dd79c519 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:34.022790 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cfb2c-9d1c-40bf-9c72-e386dd79c519 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:34.023069 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cfb2c-9d1c-40bf-9c72-e386dd79c519 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:34.024325 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 267/543] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:34.025607 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d0963-a0ae-45af-b5e5-5bc5a65488c3 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:34.025898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d0963-a0ae-45af-b5e5-5bc5a65488c3 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:34.026176 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d0963-a0ae-45af-b5e5-5bc5a65488c3 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:34.027476 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 268/544] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:34.028166 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d0963-a0ae-45af-b5e5-5bc5a65488c3 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:34.028474 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee4332-ecc7-4f26-9d86-b8555de9025b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:41:34.036294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-03ee4332-ecc7-4f26-9d86-b8555de9025b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:41:34.036294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:34.036294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:34.036294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:34.036294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:34.036294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:34.036294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:34.036294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:34.036294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:34.036294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:34.036294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:34.036294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:34.036294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:41:34.036294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:41:34.036294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:41:34.036294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:41:34.037403 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:41:34.037403 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:41:34.037403 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:41:34.037403 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:41:34.037403 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:34.037403 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:34.037403 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:34.037403 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:34.037403 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:34.037403 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:34.037403 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:34.037403 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:34.037403 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:34.037403 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:34.037403 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:34.037403 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:34.038215 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:34.038215 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:34.038215 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:34.038215 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:34.038215 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:41:34.038215 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:41:34.038215 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:41:34.038215 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:41:34.038215 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:41:34.038215 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:41:34.038215 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:41:34.038215 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:34.038215 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 277/545] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Apr 30 20:41:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:34.038989 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c2a19-2696-40db-bb3a-c81d03352f77 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:34.039257 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c2a19-2696-40db-bb3a-c81d03352f77 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:34.039533 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c2a19-2696-40db-bb3a-c81d03352f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:34.056296 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-d81c2a19-2696-40db-bb3a-c81d03352f77 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:34.057506 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-d81c2a19-2696-40db-bb3a-c81d03352f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:34.121157 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 278/546] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:41:34.122343 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ff725-e28f-48c2-bfa2-aebc973e1d52 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:34.122634 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ff725-e28f-48c2-bfa2-aebc973e1d52 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:34.122914 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ff725-e28f-48c2-bfa2-aebc973e1d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:34.128946 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d0963-a0ae-45af-b5e5-5bc5a65488c3 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:34.139136 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-a02ff725-e28f-48c2-bfa2-aebc973e1d52 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:34.140322 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-a02ff725-e28f-48c2-bfa2-aebc973e1d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:34.161948 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5ec35-aefd-404c-80cb-80d11176a28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:34.162603 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5ec35-aefd-404c-80cb-80d11176a28e None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:34.162886 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5ec35-aefd-404c-80cb-80d11176a28e None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:34.163160 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5ec35-aefd-404c-80cb-80d11176a28e None admin] PATH_INFO: `/v3/domains` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:34.163864 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5ec35-aefd-404c-80cb-80d11176a28e None admin] RBAC: Adding query filter params (name=Default) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:34.164169 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5ec35-aefd-404c-80cb-80d11176a28e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:34.165563 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5ec35-aefd-404c-80cb-80d11176a28e None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:34.176818 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 269/547] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:34.177627 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5ec35-aefd-404c-80cb-80d11176a28e None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:34.204198 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 279/548] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:41:34.213129 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ff725-e28f-48c2-bfa2-aebc973e1d52 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:34.272636 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5ec35-aefd-404c-80cb-80d11176a28e None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:34.299566 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ff725-e28f-48c2-bfa2-aebc973e1d52 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:34.303819 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d839c9-47a7-41ea-aed2-d8404ce956d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:34.304476 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d839c9-47a7-41ea-aed2-d8404ce956d6 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:34.304756 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d839c9-47a7-41ea-aed2-d8404ce956d6 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:34.305061 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d839c9-47a7-41ea-aed2-d8404ce956d6 None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:34.305796 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d839c9-47a7-41ea-aed2-d8404ce956d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:34.306096 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d839c9-47a7-41ea-aed2-d8404ce956d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:34.307451 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d839c9-47a7-41ea-aed2-d8404ce956d6 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:34.315215 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 270/549] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Apr 30 20:41:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:34.315814 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d839c9-47a7-41ea-aed2-d8404ce956d6 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:34.332204 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430353b2-6aba-4e6e-9ab6-95d937aaf727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:34.333337 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430353b2-6aba-4e6e-9ab6-95d937aaf727 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:34.333621 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430353b2-6aba-4e6e-9ab6-95d937aaf727 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:34.333883 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430353b2-6aba-4e6e-9ab6-95d937aaf727 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:34.343503 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430353b2-6aba-4e6e-9ab6-95d937aaf727 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:41:34.351556 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-430353b2-6aba-4e6e-9ab6-95d937aaf727 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:41:34.351556 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:34.351556 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:34.351556 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:34.351556 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:34.351556 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:34.351556 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:34.351556 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:34.351556 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:34.351556 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:34.351556 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:34.351556 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:34.351556 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:41:34.351556 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:41:34.351556 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:41:34.351556 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:41:34.352476 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:41:34.352476 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:41:34.352476 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:41:34.352476 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:41:34.352476 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:34.352476 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:34.352476 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:34.352476 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:34.352476 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:34.352476 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:34.352476 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:34.352476 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:34.352476 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:34.352476 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:34.352476 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:34.352476 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:34.353363 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:34.353363 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:34.353363 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:34.353363 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:34.353363 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:41:34.353363 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:41:34.353363 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:41:34.353363 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:41:34.353363 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:41:34.353363 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:41:34.353363 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:41:34.353363 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:34.353363 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 280/550] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Apr 30 20:41:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:34.354101 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430353b2-6aba-4e6e-9ab6-95d937aaf727 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:34.411332 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d839c9-47a7-41ea-aed2-d8404ce956d6 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:34.443414 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd55879-bd88-4f50-a4f4-c287bbd6b307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:34.444206 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd55879-bd88-4f50-a4f4-c287bbd6b307 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:34.444482 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd55879-bd88-4f50-a4f4-c287bbd6b307 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:34.444763 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd55879-bd88-4f50-a4f4-c287bbd6b307 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:34.447291 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430353b2-6aba-4e6e-9ab6-95d937aaf727 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:34.451285 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd55879-bd88-4f50-a4f4-c287bbd6b307 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:34.452712 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd55879-bd88-4f50-a4f4-c287bbd6b307 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:34.466449 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-4bd55879-bd88-4f50-a4f4-c287bbd6b307 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:41:34.466449 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:34.466449 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:34.466449 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:34.466449 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:34.466449 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:34.466449 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:34.466449 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:34.466449 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:34.466449 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:34.466449 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:34.466449 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:34.466449 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:41:34.466449 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:41:34.466449 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:41:34.467294 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:41:34.467294 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:34.467294 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:34.467294 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:34.467294 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:34.467294 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:34.467294 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:34.467294 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:34.467294 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:34.467294 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:34.467294 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:34.467294 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:34.467294 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:34.467294 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:34.467294 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:34.467294 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:34.467294 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:34.468155 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:41:34.468155 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:41:34.468155 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:41:34.468155 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:41:34.468155 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:41:34.468155 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:41:34.468155 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:41:34.468155 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:34.468155 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 271/551] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:41:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:34.468609 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd55879-bd88-4f50-a4f4-c287bbd6b307 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:34.484021 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498e273-82a7-4668-a287-717ad386000d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:34.484810 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498e273-82a7-4668-a287-717ad386000d None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:34.485120 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498e273-82a7-4668-a287-717ad386000d None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:34.485394 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498e273-82a7-4668-a287-717ad386000d None admin] PATH_INFO: `/v3/roles/service` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:34.497046 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498e273-82a7-4668-a287-717ad386000d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:41:34.504768 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-0498e273-82a7-4668-a287-717ad386000d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:41:34.504768 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:34.504768 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:34.504768 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:34.504768 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:34.504768 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:34.504768 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:34.504768 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:34.504768 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:34.504768 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:34.504768 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:34.504768 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:34.504768 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:41:34.504768 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:41:34.504768 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:41:34.504768 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:41:34.505691 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:41:34.505691 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:41:34.505691 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:41:34.505691 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:41:34.505691 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:34.505691 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:34.505691 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:34.505691 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:34.505691 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:34.505691 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:34.505691 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:34.505691 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:34.505691 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:34.505691 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:34.505691 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:34.505691 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:34.506489 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:34.506489 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:34.506489 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:34.506489 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:34.506489 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:41:34.506489 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:41:34.506489 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:41:34.506489 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:41:34.506489 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:41:34.506489 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:41:34.506489 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:41:34.506489 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:34.506489 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 281/552] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Apr 30 20:41:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:34.507961 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498e273-82a7-4668-a287-717ad386000d None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:34.565974 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd55879-bd88-4f50-a4f4-c287bbd6b307 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:34.598446 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78dbea8-c566-4550-8e33-7527b9ad9c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:34.599227 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dbea8-c566-4550-8e33-7527b9ad9c9f None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:34.599510 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dbea8-c566-4550-8e33-7527b9ad9c9f None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:34.599783 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dbea8-c566-4550-8e33-7527b9ad9c9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:34.599872 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498e273-82a7-4668-a287-717ad386000d None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:34.609704 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78dbea8-c566-4550-8e33-7527b9ad9c9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:34.611358 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78dbea8-c566-4550-8e33-7527b9ad9c9f None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:34.628836 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-d78dbea8-c566-4550-8e33-7527b9ad9c9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:34.628836 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:34.628836 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:34.628836 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:34.628836 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:34.628836 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:34.628836 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:34.628836 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:34.628836 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:34.628836 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:34.628836 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:34.628836 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:34.628836 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:41:34.628836 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:41:34.628836 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:41:34.629773 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:41:34.629773 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:34.629773 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:34.629773 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:34.629773 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:34.629773 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:34.629773 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:34.629773 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:34.629773 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:34.629773 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:34.629773 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:34.629773 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:34.629773 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:34.629773 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:34.629773 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:34.629773 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:34.629773 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:34.630610 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:41:34.630610 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:41:34.630610 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:34.630610 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:34.630610 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 272/553] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:34.630928 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78dbea8-c566-4550-8e33-7527b9ad9c9f None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:34.639264 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51087a2a-fe44-422d-b667-734614fdb118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:34.639934 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51087a2a-fe44-422d-b667-734614fdb118 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:34.640216 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51087a2a-fe44-422d-b667-734614fdb118 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:34.640487 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51087a2a-fe44-422d-b667-734614fdb118 None admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:34.641251 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51087a2a-fe44-422d-b667-734614fdb118 None admin] RBAC: Adding query filter params (name=service) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:34.641558 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51087a2a-fe44-422d-b667-734614fdb118 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:34.643417 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51087a2a-fe44-422d-b667-734614fdb118 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:34.651329 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 282/554] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Apr 30 20:41:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:34.652114 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51087a2a-fe44-422d-b667-734614fdb118 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:34.725215 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78dbea8-c566-4550-8e33-7527b9ad9c9f None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:34.746931 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51087a2a-fe44-422d-b667-734614fdb118 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:34.757443 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a60a9-96f7-4379-9c53-4201e03cdd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:34.758091 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a60a9-96f7-4379-9c53-4201e03cdd16 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:34.758373 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a60a9-96f7-4379-9c53-4201e03cdd16 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:34.758645 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a60a9-96f7-4379-9c53-4201e03cdd16 None admin] PATH_INFO: `/v3/projects` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:34.759413 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a60a9-96f7-4379-9c53-4201e03cdd16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:34.759718 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a60a9-96f7-4379-9c53-4201e03cdd16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:34.761180 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a60a9-96f7-4379-9c53-4201e03cdd16 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:34.779592 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 273/555] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Apr 30 20:41:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:34.780169 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb976e-5edf-432f-9c0e-44841352348c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:34.780430 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a60a9-96f7-4379-9c53-4201e03cdd16 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:34.780528 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb976e-5edf-432f-9c0e-44841352348c None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:34.780703 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb976e-5edf-432f-9c0e-44841352348c None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:34.781005 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb976e-5edf-432f-9c0e-44841352348c None admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:34.781739 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb976e-5edf-432f-9c0e-44841352348c None admin] RBAC: Adding query filter params (name=service) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:34.782046 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb976e-5edf-432f-9c0e-44841352348c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:34.783500 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb976e-5edf-432f-9c0e-44841352348c None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:34.791621 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 283/556] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Apr 30 20:41:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:34.792416 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb976e-5edf-432f-9c0e-44841352348c None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:34.878712 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a60a9-96f7-4379-9c53-4201e03cdd16 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:34.887207 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb976e-5edf-432f-9c0e-44841352348c None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:34.909932 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35861660-fe0b-45c8-9e4b-34f5a9ca70d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:34.910575 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35861660-fe0b-45c8-9e4b-34f5a9ca70d4 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:34.910850 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35861660-fe0b-45c8-9e4b-34f5a9ca70d4 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:34.911119 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35861660-fe0b-45c8-9e4b-34f5a9ca70d4 None admin] PATH_INFO: `/v3/domains` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:34.911816 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35861660-fe0b-45c8-9e4b-34f5a9ca70d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:34.912116 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35861660-fe0b-45c8-9e4b-34f5a9ca70d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:34.913502 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35861660-fe0b-45c8-9e4b-34f5a9ca70d4 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:34.920964 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079132b-f0ac-44dd-9acd-03800e4c819d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:34.921742 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079132b-f0ac-44dd-9acd-03800e4c819d None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:34.922022 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079132b-f0ac-44dd-9acd-03800e4c819d None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:34.922294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079132b-f0ac-44dd-9acd-03800e4c819d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:34.925985 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 274/557] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:34.926739 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35861660-fe0b-45c8-9e4b-34f5a9ca70d4 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:34.933308 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079132b-f0ac-44dd-9acd-03800e4c819d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:34.934758 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079132b-f0ac-44dd-9acd-03800e4c819d None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:34.951983 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-5079132b-f0ac-44dd-9acd-03800e4c819d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:34.951983 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:34.951983 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:34.951983 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:34.951983 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:34.951983 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:34.951983 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:34.951983 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:34.951983 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:34.951983 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:34.951983 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:34.951983 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:34.951983 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:41:34.951983 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:41:34.951983 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:41:34.953011 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:41:34.953011 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:34.953011 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:34.953011 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:34.953011 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:34.953011 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:34.953011 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:34.953011 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:34.953011 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:34.953011 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:34.953011 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:34.953011 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:34.953011 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:34.953011 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:34.953011 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:34.953011 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:34.953011 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:34.954064 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:41:34.954064 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:41:34.954064 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:34.954064 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:34.954064 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 284/558] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:34.954503 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079132b-f0ac-44dd-9acd-03800e4c819d None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:35.021056 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35861660-fe0b-45c8-9e4b-34f5a9ca70d4 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:35.052824 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079132b-f0ac-44dd-9acd-03800e4c819d None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:35.064843 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58df7a-488f-4083-939a-6245cc049160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:35.065759 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58df7a-488f-4083-939a-6245cc049160 None admin] REQUEST_METHOD: `PUT` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:35.066043 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58df7a-488f-4083-939a-6245cc049160 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:35.066315 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58df7a-488f-4083-939a-6245cc049160 None admin] PATH_INFO: `/v3/projects/45ddbc3ac9ff421598cbe53e1252d289/users/2aee3a7a6b4b4d489993c131f3ae2048/roles/65db0aa5d0b04764ab538efe5f356652` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:35.080452 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58df7a-488f-4083-939a-6245cc049160 None admin] RBAC: Authorizing `identity:create_grant(project_id=45ddbc3ac9ff421598cbe53e1252d289, user_id=2aee3a7a6b4b4d489993c131f3ae2048, role_id=65db0aa5d0b04764ab538efe5f356652)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:35.081922 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58df7a-488f-4083-939a-6245cc049160 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:35.085713 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dec4ef-c13b-4cba-b6da-22c15d3a3a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:35.086496 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dec4ef-c13b-4cba-b6da-22c15d3a3a21 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:35.086777 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dec4ef-c13b-4cba-b6da-22c15d3a3a21 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:35.087049 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dec4ef-c13b-4cba-b6da-22c15d3a3a21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:35.097428 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dec4ef-c13b-4cba-b6da-22c15d3a3a21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:35.098873 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dec4ef-c13b-4cba-b6da-22c15d3a3a21 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:35.116298 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-75dec4ef-c13b-4cba-b6da-22c15d3a3a21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:35.116298 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:35.116298 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:35.116298 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:35.116298 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:35.116298 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:35.116298 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:35.116298 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:35.116298 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:35.116298 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:35.116298 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:35.116298 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:35.116298 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:41:35.116298 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:41:35.116298 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:41:35.117291 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:41:35.117291 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:35.117291 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:35.117291 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:35.117291 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:35.117291 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:35.117291 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:35.117291 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:35.117291 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:35.117291 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:35.117291 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:35.117291 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:35.117291 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:35.117291 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:35.117291 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:35.117291 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:35.117291 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:35.118258 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:41:35.118258 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:41:35.118258 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:35.118258 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:35.118258 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 285/559] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:35.118258 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dec4ef-c13b-4cba-b6da-22c15d3a3a21 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:35.159584 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 275/560] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Apr 30 20:41:34 2022] PUT /identity/v3/projects/45ddbc3ac9ff421598cbe53e1252d289/users/2aee3a7a6b4b4d489993c131f3ae2048/roles/65db0aa5d0b04764ab538efe5f356652 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:41:35.160410 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58df7a-488f-4083-939a-6245cc049160 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:35.219516 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dec4ef-c13b-4cba-b6da-22c15d3a3a21 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:35.256982 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad57bd-a86c-468c-ae9a-02e879783dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:35.257968 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad57bd-a86c-468c-ae9a-02e879783dae None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:35.258247 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad57bd-a86c-468c-ae9a-02e879783dae None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:35.258573 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad57bd-a86c-468c-ae9a-02e879783dae None admin] PATH_INFO: `/v3/users/glance` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:35.267076 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad57bd-a86c-468c-ae9a-02e879783dae None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:35.268584 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad57bd-a86c-468c-ae9a-02e879783dae None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:35.269611 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58df7a-488f-4083-939a-6245cc049160 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:35.284570 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-c8ad57bd-a86c-468c-ae9a-02e879783dae None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 30 20:41:35.284570 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:35.284570 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:35.284570 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:35.284570 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:35.284570 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:35.284570 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:35.284570 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:35.284570 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:35.284570 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:35.284570 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:35.284570 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:35.284570 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:41:35.284570 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:41:35.284570 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:41:35.284570 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:41:35.285721 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:35.285721 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:35.285721 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:41:35.285721 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:41:35.285721 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:41:35.285721 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:41:35.285721 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:35.285721 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:35.285721 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:35.285721 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:35.285721 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:35.285721 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:35.285721 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:35.285721 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:35.285721 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:35.285721 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:35.285721 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:35.285721 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:35.286783 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:35.286783 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:35.286783 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:41:35.286783 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:41:35.286783 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:41:35.286783 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:41:35.286783 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:41:35.286783 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:41:35.286783 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Apr 30 20:41:35.286783 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:35.286783 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 286/561] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:41:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:35.286783 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad57bd-a86c-468c-ae9a-02e879783dae None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:35.315864 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9c101-d992-40fd-9227-1301cb4a79ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:35.316736 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9c101-d992-40fd-9227-1301cb4a79ee None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:35.317158 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9c101-d992-40fd-9227-1301cb4a79ee None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:35.317644 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9c101-d992-40fd-9227-1301cb4a79ee None admin] PATH_INFO: `/v3/domains` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:35.318787 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9c101-d992-40fd-9227-1301cb4a79ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:35.319249 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9c101-d992-40fd-9227-1301cb4a79ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:35.320549 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9c101-d992-40fd-9227-1301cb4a79ee None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:35.333310 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 276/562] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:35.334436 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9c101-d992-40fd-9227-1301cb4a79ee None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:35.399560 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad57bd-a86c-468c-ae9a-02e879783dae None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:35.436560 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08cacc-ef87-40c5-9987-410ce8e798c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:35.437508 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08cacc-ef87-40c5-9987-410ce8e798c2 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:35.437798 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08cacc-ef87-40c5-9987-410ce8e798c2 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:35.438072 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08cacc-ef87-40c5-9987-410ce8e798c2 None admin] PATH_INFO: `/v3/domains` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:35.438787 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f08cacc-ef87-40c5-9987-410ce8e798c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:35.439588 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f08cacc-ef87-40c5-9987-410ce8e798c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:35.440997 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f08cacc-ef87-40c5-9987-410ce8e798c2 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:35.448783 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9c101-d992-40fd-9227-1301cb4a79ee None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:35.458399 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 287/563] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:35.458399 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08cacc-ef87-40c5-9987-410ce8e798c2 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:35.487068 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a8a2e-2da9-4de6-914f-9dab82f90b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:35.487839 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a8a2e-2da9-4de6-914f-9dab82f90b7b None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:35.488205 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a8a2e-2da9-4de6-914f-9dab82f90b7b None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:35.488540 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a8a2e-2da9-4de6-914f-9dab82f90b7b None admin] PATH_INFO: `/v3/users` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:35.489475 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a8a2e-2da9-4de6-914f-9dab82f90b7b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:35.489866 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a8a2e-2da9-4de6-914f-9dab82f90b7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:35.491440 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a8a2e-2da9-4de6-914f-9dab82f90b7b None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:35.516015 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 277/564] 10.222.0.26 () {56 vars in 1137 bytes} [Sat Apr 30 20:41:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:35.516015 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a8a2e-2da9-4de6-914f-9dab82f90b7b None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:35.560869 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08cacc-ef87-40c5-9987-410ce8e798c2 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:35.595718 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc86bd3-64bf-4a59-9090-33c847bba92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:35.596692 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc86bd3-64bf-4a59-9090-33c847bba92d None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:35.597079 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc86bd3-64bf-4a59-9090-33c847bba92d None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:35.597433 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc86bd3-64bf-4a59-9090-33c847bba92d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:35.605154 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc86bd3-64bf-4a59-9090-33c847bba92d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:35.606701 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc86bd3-64bf-4a59-9090-33c847bba92d None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:35.611314 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a8a2e-2da9-4de6-914f-9dab82f90b7b None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:35.622344 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-4fc86bd3-64bf-4a59-9090-33c847bba92d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 30 20:41:35.622344 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:35.622344 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:35.622344 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:35.622344 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:35.622344 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:35.622344 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:35.622344 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:35.622344 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:35.622344 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:35.622344 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:35.622344 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:35.622344 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:41:35.622344 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:41:35.622344 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:41:35.622344 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:41:35.623422 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:35.623422 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:35.623422 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:41:35.623422 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:41:35.623422 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:41:35.623422 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:41:35.623422 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:35.623422 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:35.623422 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:35.623422 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:35.623422 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:35.623422 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:35.623422 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:35.623422 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:35.623422 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:35.623422 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:35.623422 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:35.623422 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:35.624713 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:35.624713 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:35.624713 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:41:35.624713 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:41:35.624713 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:41:35.624713 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:41:35.624713 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:41:35.624713 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:41:35.624713 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Apr 30 20:41:35.624713 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:35.624713 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 288/565] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:41:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:35.624713 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc86bd3-64bf-4a59-9090-33c847bba92d None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:35.653630 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f088b02-87ce-4c80-b7bf-f71a6dde56ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:35.654576 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f088b02-87ce-4c80-b7bf-f71a6dde56ec None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:35.654873 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f088b02-87ce-4c80-b7bf-f71a6dde56ec None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:35.655152 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f088b02-87ce-4c80-b7bf-f71a6dde56ec None admin] PATH_INFO: `/v3/users/neutron` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:35.664787 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f088b02-87ce-4c80-b7bf-f71a6dde56ec None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:35.666288 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f088b02-87ce-4c80-b7bf-f71a6dde56ec None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:35.682992 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-5f088b02-87ce-4c80-b7bf-f71a6dde56ec None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 30 20:41:35.682992 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:35.682992 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:35.682992 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:35.682992 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:35.682992 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:35.682992 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:35.682992 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:35.682992 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:35.682992 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:35.682992 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:35.682992 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:35.682992 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:41:35.682992 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:41:35.682992 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:41:35.682992 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:41:35.684083 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:35.684083 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:35.684083 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:41:35.684083 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:41:35.684083 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:41:35.684083 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:41:35.684083 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:35.684083 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:35.684083 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:35.684083 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:35.684083 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:35.684083 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:35.684083 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:35.684083 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:35.684083 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:35.684083 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:35.684083 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:35.684083 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:35.685468 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:35.685468 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:35.685468 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:41:35.685468 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:41:35.685468 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:41:35.685468 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:41:35.685468 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:41:35.685468 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:41:35.685468 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Apr 30 20:41:35.685468 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:35.685468 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 278/566] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Apr 30 20:41:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:35.686077 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f088b02-87ce-4c80-b7bf-f71a6dde56ec None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:35.731473 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc86bd3-64bf-4a59-9090-33c847bba92d None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:35.765725 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604be34-1218-4266-918e-eef66ddbe2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:35.766510 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604be34-1218-4266-918e-eef66ddbe2ad None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:35.766787 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604be34-1218-4266-918e-eef66ddbe2ad None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:35.767909 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604be34-1218-4266-918e-eef66ddbe2ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:35.777889 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4604be34-1218-4266-918e-eef66ddbe2ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:35.779338 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4604be34-1218-4266-918e-eef66ddbe2ad None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:35.783557 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f088b02-87ce-4c80-b7bf-f71a6dde56ec None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:35.797034 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-4604be34-1218-4266-918e-eef66ddbe2ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:35.797034 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:35.797034 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:35.797034 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:35.797034 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:35.797034 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:35.797034 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:35.797034 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:35.797034 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:35.797034 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:35.797034 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:35.797034 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:35.797034 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:41:35.797034 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:41:35.797034 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:41:35.797937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:41:35.797937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:35.797937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:35.797937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:35.797937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:35.797937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:35.797937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:35.797937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:35.797937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:35.797937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:35.797937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:35.797937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:35.797937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:35.797937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:35.797937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:35.797937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:35.797937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:35.798799 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:41:35.798799 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:41:35.798799 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:35.798799 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:35.802914 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 289/567] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:35.803518 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604be34-1218-4266-918e-eef66ddbe2ad None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:35.822519 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d71a15-6abc-4527-bde3-6eca5e8c33fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:35.823199 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d71a15-6abc-4527-bde3-6eca5e8c33fb None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:35.823483 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d71a15-6abc-4527-bde3-6eca5e8c33fb None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:35.823759 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d71a15-6abc-4527-bde3-6eca5e8c33fb None admin] PATH_INFO: `/v3/users` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:35.824613 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d71a15-6abc-4527-bde3-6eca5e8c33fb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:35.825196 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d71a15-6abc-4527-bde3-6eca5e8c33fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:35.826377 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d71a15-6abc-4527-bde3-6eca5e8c33fb None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:35.843861 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 279/568] 10.222.0.26 () {56 vars in 1137 bytes} [Sat Apr 30 20:41:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:35.844980 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d71a15-6abc-4527-bde3-6eca5e8c33fb None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:35.903307 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604be34-1218-4266-918e-eef66ddbe2ad None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:35.936077 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906f333-38da-46b7-b15c-ef98da095684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:35.937295 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906f333-38da-46b7-b15c-ef98da095684 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:35.937793 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906f333-38da-46b7-b15c-ef98da095684 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:35.938128 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906f333-38da-46b7-b15c-ef98da095684 None admin] PATH_INFO: `/v3/users` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:35.939949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906f333-38da-46b7-b15c-ef98da095684 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:35.940365 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906f333-38da-46b7-b15c-ef98da095684 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:35.941942 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906f333-38da-46b7-b15c-ef98da095684 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:35.946808 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d71a15-6abc-4527-bde3-6eca5e8c33fb None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:35.959955 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 290/569] 10.222.0.26 () {56 vars in 1139 bytes} [Sat Apr 30 20:41:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:35.960864 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906f333-38da-46b7-b15c-ef98da095684 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:35.981959 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908835e-13c1-430d-b230-0b5b6cb72cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:35.982647 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908835e-13c1-430d-b230-0b5b6cb72cf3 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:35.982917 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908835e-13c1-430d-b230-0b5b6cb72cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:35.983193 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908835e-13c1-430d-b230-0b5b6cb72cf3 None admin] PATH_INFO: `/v3/domains` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:35.984008 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9908835e-13c1-430d-b230-0b5b6cb72cf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:35.984323 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9908835e-13c1-430d-b230-0b5b6cb72cf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:35.985810 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9908835e-13c1-430d-b230-0b5b6cb72cf3 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:36.002085 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 280/570] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:36.002085 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908835e-13c1-430d-b230-0b5b6cb72cf3 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:36.060644 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906f333-38da-46b7-b15c-ef98da095684 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:36.093598 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f415c-fcab-49d7-928f-a4c328023caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:36.094308 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f415c-fcab-49d7-928f-a4c328023caf None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:36.094584 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f415c-fcab-49d7-928f-a4c328023caf None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:36.094859 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f415c-fcab-49d7-928f-a4c328023caf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:36.101129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908835e-13c1-430d-b230-0b5b6cb72cf3 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:36.106729 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f415c-fcab-49d7-928f-a4c328023caf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:36.108194 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f415c-fcab-49d7-928f-a4c328023caf None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:36.128152 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-2e5f415c-fcab-49d7-928f-a4c328023caf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:36.128152 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:36.128152 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:36.128152 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:36.128152 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:36.128152 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:36.128152 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:36.128152 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:36.128152 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:36.128152 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:36.128152 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:36.128152 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:36.128152 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:41:36.128152 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:41:36.128152 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:41:36.129596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:41:36.129596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:36.129596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:36.129596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:36.129596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:36.129596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:36.129596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:36.129596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:36.129596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:36.129596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:36.129596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:36.129596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:36.129596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:36.129596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:36.129596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:36.129596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:36.129596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:36.130583 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:41:36.130583 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:41:36.130583 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:36.130583 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:36.130583 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 291/571] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:36.130583 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f415c-fcab-49d7-928f-a4c328023caf None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:36.143908 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a47c9-a3c8-4ce7-94c0-a1686ac1b18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:36.144703 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a47c9-a3c8-4ce7-94c0-a1686ac1b18d None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:36.145009 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a47c9-a3c8-4ce7-94c0-a1686ac1b18d None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:36.145285 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a47c9-a3c8-4ce7-94c0-a1686ac1b18d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:36.156231 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a47c9-a3c8-4ce7-94c0-a1686ac1b18d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:36.158213 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a47c9-a3c8-4ce7-94c0-a1686ac1b18d None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:36.175129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-248a47c9-a3c8-4ce7-94c0-a1686ac1b18d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:36.175129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:36.175129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:36.175129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:36.175129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:36.175129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:36.175129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:36.175129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:36.175129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:36.175129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:36.175129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:36.175129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:36.175129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:41:36.175129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:41:36.175129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:41:36.176175 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:41:36.176175 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:36.176175 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:36.176175 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:36.176175 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:36.176175 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:36.176175 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:36.176175 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:36.176175 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:36.176175 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:36.176175 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:36.176175 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:36.176175 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:36.176175 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:36.176175 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:36.176175 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:36.176175 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:36.177128 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:41:36.177128 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:41:36.177128 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:36.177128 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:36.177128 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 281/572] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:36.177128 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a47c9-a3c8-4ce7-94c0-a1686ac1b18d None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:36.238588 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f415c-fcab-49d7-928f-a4c328023caf None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:36.272761 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca61fe8-0b17-4680-a066-334d170d1372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:36.273593 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca61fe8-0b17-4680-a066-334d170d1372 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:36.273870 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca61fe8-0b17-4680-a066-334d170d1372 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:36.274159 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca61fe8-0b17-4680-a066-334d170d1372 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:36.280750 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca61fe8-0b17-4680-a066-334d170d1372 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:36.282250 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca61fe8-0b17-4680-a066-334d170d1372 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:36.284655 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a47c9-a3c8-4ce7-94c0-a1686ac1b18d None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:36.296417 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-8ca61fe8-0b17-4680-a066-334d170d1372 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:41:36.296417 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:36.296417 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:36.296417 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:36.296417 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:36.296417 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:36.296417 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:36.296417 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:36.296417 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:36.296417 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:36.296417 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:36.296417 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:36.296417 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:41:36.296417 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:41:36.296417 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:41:36.297390 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:41:36.297390 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:36.297390 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:36.297390 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:36.297390 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:36.297390 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:36.297390 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:36.297390 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:36.297390 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:36.297390 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:36.297390 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:36.297390 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:36.297390 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:36.297390 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:36.297390 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:36.297390 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:36.297390 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:36.298353 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:41:36.298353 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:41:36.298353 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:41:36.298353 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:41:36.298353 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:41:36.298353 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:41:36.298353 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:41:36.298353 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:36.302520 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 292/573] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:41:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:36.303145 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca61fe8-0b17-4680-a066-334d170d1372 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:36.319823 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee2774-398d-42f2-a3ce-f4866055bb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:36.320487 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee2774-398d-42f2-a3ce-f4866055bb6c None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:36.320774 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee2774-398d-42f2-a3ce-f4866055bb6c None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:36.321082 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee2774-398d-42f2-a3ce-f4866055bb6c None admin] PATH_INFO: `/v3/domains` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:36.321791 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee2774-398d-42f2-a3ce-f4866055bb6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:36.322097 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee2774-398d-42f2-a3ce-f4866055bb6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:36.323464 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee2774-398d-42f2-a3ce-f4866055bb6c None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:36.340720 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 282/574] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:36.340720 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee2774-398d-42f2-a3ce-f4866055bb6c None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:36.409858 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca61fe8-0b17-4680-a066-334d170d1372 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:36.438386 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee2774-398d-42f2-a3ce-f4866055bb6c None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:36.443938 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4824fd-4732-4a7e-b5a1-5507a90ecf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:36.444596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4824fd-4732-4a7e-b5a1-5507a90ecf35 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:36.444876 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4824fd-4732-4a7e-b5a1-5507a90ecf35 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:36.445179 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4824fd-4732-4a7e-b5a1-5507a90ecf35 None admin] PATH_INFO: `/v3/domains` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:36.445886 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4824fd-4732-4a7e-b5a1-5507a90ecf35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:36.446190 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4824fd-4732-4a7e-b5a1-5507a90ecf35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:36.447567 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4824fd-4732-4a7e-b5a1-5507a90ecf35 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:36.463810 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 293/575] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:36.463810 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4824fd-4732-4a7e-b5a1-5507a90ecf35 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:36.478304 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321d878-5d25-4999-bc8e-358fbf6f4bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:36.479119 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321d878-5d25-4999-bc8e-358fbf6f4bf4 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:36.479475 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321d878-5d25-4999-bc8e-358fbf6f4bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:36.479826 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321d878-5d25-4999-bc8e-358fbf6f4bf4 None admin] PATH_INFO: `/v3/projects` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:36.480605 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321d878-5d25-4999-bc8e-358fbf6f4bf4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:36.480936 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321d878-5d25-4999-bc8e-358fbf6f4bf4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:36.482352 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321d878-5d25-4999-bc8e-358fbf6f4bf4 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:36.494582 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 283/576] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Apr 30 20:41:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:36.495399 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321d878-5d25-4999-bc8e-358fbf6f4bf4 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:36.570895 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4824fd-4732-4a7e-b5a1-5507a90ecf35 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:36.593054 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321d878-5d25-4999-bc8e-358fbf6f4bf4 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:36.604865 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ced7b8-04c0-4e67-9d24-54428d548342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:36.605690 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ced7b8-04c0-4e67-9d24-54428d548342 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:36.605968 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ced7b8-04c0-4e67-9d24-54428d548342 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:36.606234 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ced7b8-04c0-4e67-9d24-54428d548342 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:36.613568 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ced7b8-04c0-4e67-9d24-54428d548342 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:36.615013 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ced7b8-04c0-4e67-9d24-54428d548342 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:36.627777 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e829931-7747-41c5-8e68-cccda477f64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:36.628569 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e829931-7747-41c5-8e68-cccda477f64e None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:36.628855 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e829931-7747-41c5-8e68-cccda477f64e None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:36.629164 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e829931-7747-41c5-8e68-cccda477f64e None admin] PATH_INFO: `/v3/projects/service` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:36.629402 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-d4ced7b8-04c0-4e67-9d24-54428d548342 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:41:36.629402 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:36.629402 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:36.629402 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:36.629402 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:36.629402 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:36.629402 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:36.629402 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:36.629402 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:36.629402 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:36.629402 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:36.629402 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:36.629402 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:41:36.629402 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:41:36.629402 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:41:36.630239 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:41:36.630239 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:36.630239 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:36.630239 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:36.630239 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:36.630239 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:36.630239 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:36.630239 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:36.630239 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:36.630239 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:36.630239 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:36.630239 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:36.630239 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:36.630239 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:36.630239 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:36.630239 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:36.630239 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:36.631160 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:41:36.631160 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:41:36.631160 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:41:36.631160 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:41:36.631160 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:41:36.631160 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:41:36.631160 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:41:36.631160 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:36.631160 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 294/577] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:41:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:36.631632 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ced7b8-04c0-4e67-9d24-54428d548342 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:36.640191 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e829931-7747-41c5-8e68-cccda477f64e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:36.641667 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e829931-7747-41c5-8e68-cccda477f64e None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:36.657385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-3e829931-7747-41c5-8e68-cccda477f64e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:41:36.657385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:36.657385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:36.657385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:36.657385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:36.657385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:36.657385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:36.657385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:36.657385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:36.657385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:36.657385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:36.657385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:36.657385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:41:36.657385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:41:36.657385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:41:36.658303 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:41:36.658303 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:36.658303 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:36.658303 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:36.658303 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:36.658303 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:36.658303 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:36.658303 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:36.658303 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:36.658303 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:36.658303 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:36.658303 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:36.658303 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:36.658303 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:36.658303 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:36.658303 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:36.658303 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:36.659213 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:41:36.659213 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:41:36.659213 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:41:36.659213 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:41:36.659213 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:41:36.659213 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:41:36.659213 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:41:36.659213 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:36.661109 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 284/578] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:41:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:36.662581 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e829931-7747-41c5-8e68-cccda477f64e None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:36.738902 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ced7b8-04c0-4e67-9d24-54428d548342 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:36.759728 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e829931-7747-41c5-8e68-cccda477f64e None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:36.772308 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe5be8-0c9d-4567-ad80-a63f07f3ba10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:36.773242 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe5be8-0c9d-4567-ad80-a63f07f3ba10 None admin] REQUEST_METHOD: `PUT` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:36.773530 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe5be8-0c9d-4567-ad80-a63f07f3ba10 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:36.773809 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe5be8-0c9d-4567-ad80-a63f07f3ba10 None admin] PATH_INFO: `/v3/projects/45ddbc3ac9ff421598cbe53e1252d289/users/43ed44bbd52047cbbcab1bc72d650b8e/roles/65db0aa5d0b04764ab538efe5f356652` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:36.788796 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe5be8-0c9d-4567-ad80-a63f07f3ba10 None admin] RBAC: Authorizing `identity:create_grant(project_id=45ddbc3ac9ff421598cbe53e1252d289, user_id=43ed44bbd52047cbbcab1bc72d650b8e, role_id=65db0aa5d0b04764ab538efe5f356652)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:36.790448 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe5be8-0c9d-4567-ad80-a63f07f3ba10 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:36.794930 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3762d7-ced1-47f8-aad7-282b0696ea7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:36.795590 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3762d7-ced1-47f8-aad7-282b0696ea7b None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:36.795875 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3762d7-ced1-47f8-aad7-282b0696ea7b None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:36.796149 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3762d7-ced1-47f8-aad7-282b0696ea7b None admin] PATH_INFO: `/v3/projects` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:36.796954 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3762d7-ced1-47f8-aad7-282b0696ea7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:36.797271 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3762d7-ced1-47f8-aad7-282b0696ea7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:36.799687 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3762d7-ced1-47f8-aad7-282b0696ea7b None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:36.812186 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 285/579] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Apr 30 20:41:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:36.813830 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3762d7-ced1-47f8-aad7-282b0696ea7b None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:36.890407 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 295/580] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Apr 30 20:41:36 2022] PUT /identity/v3/projects/45ddbc3ac9ff421598cbe53e1252d289/users/43ed44bbd52047cbbcab1bc72d650b8e/roles/65db0aa5d0b04764ab538efe5f356652 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:41:36.891683 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe5be8-0c9d-4567-ad80-a63f07f3ba10 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:36.915945 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3762d7-ced1-47f8-aad7-282b0696ea7b None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:36.953000 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6debf2-b653-41e0-bcf6-5dafc0d4d5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:36.953781 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6debf2-b653-41e0-bcf6-5dafc0d4d5de None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:36.953988 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6debf2-b653-41e0-bcf6-5dafc0d4d5de None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:36.954235 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6debf2-b653-41e0-bcf6-5dafc0d4d5de None admin] PATH_INFO: `/v3/projects` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:36.955179 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6debf2-b653-41e0-bcf6-5dafc0d4d5de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:36.955492 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6debf2-b653-41e0-bcf6-5dafc0d4d5de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:36.956998 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6debf2-b653-41e0-bcf6-5dafc0d4d5de None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:36.971262 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 286/581] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Apr 30 20:41:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:36.977606 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6debf2-b653-41e0-bcf6-5dafc0d4d5de None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:37.011871 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe5be8-0c9d-4567-ad80-a63f07f3ba10 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:37.050543 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bbc24-71dc-4f87-84ad-9003094683f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:37.051700 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bbc24-71dc-4f87-84ad-9003094683f8 None admin] REQUEST_METHOD: `PUT` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:37.052153 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bbc24-71dc-4f87-84ad-9003094683f8 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:37.052571 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bbc24-71dc-4f87-84ad-9003094683f8 None admin] PATH_INFO: `/v3/projects/45ddbc3ac9ff421598cbe53e1252d289/users/ec3374e008274f9eb4476b9f6a528fa6/roles/65db0aa5d0b04764ab538efe5f356652` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:37.070516 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1bbc24-71dc-4f87-84ad-9003094683f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=45ddbc3ac9ff421598cbe53e1252d289, user_id=ec3374e008274f9eb4476b9f6a528fa6, role_id=65db0aa5d0b04764ab538efe5f356652)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:37.072481 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1bbc24-71dc-4f87-84ad-9003094683f8 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:37.106175 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6debf2-b653-41e0-bcf6-5dafc0d4d5de None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:37.144510 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c18fc-4708-431f-ae8e-045ab422ff3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:37.145462 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c18fc-4708-431f-ae8e-045ab422ff3c None admin] REQUEST_METHOD: `PUT` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:37.145768 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c18fc-4708-431f-ae8e-045ab422ff3c None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:37.146047 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c18fc-4708-431f-ae8e-045ab422ff3c None admin] PATH_INFO: `/v3/projects/45ddbc3ac9ff421598cbe53e1252d289/users/9918e808c77e4017a64c96ad24164b37/roles/65db0aa5d0b04764ab538efe5f356652` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:37.161531 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c18fc-4708-431f-ae8e-045ab422ff3c None admin] RBAC: Authorizing `identity:create_grant(project_id=45ddbc3ac9ff421598cbe53e1252d289, user_id=9918e808c77e4017a64c96ad24164b37, role_id=65db0aa5d0b04764ab538efe5f356652)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:37.163049 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c18fc-4708-431f-ae8e-045ab422ff3c None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:37.192857 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 296/582] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Apr 30 20:41:36 2022] PUT /identity/v3/projects/45ddbc3ac9ff421598cbe53e1252d289/users/ec3374e008274f9eb4476b9f6a528fa6/roles/65db0aa5d0b04764ab538efe5f356652 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:41:37.250468 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 287/583] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Apr 30 20:41:36 2022] PUT /identity/v3/projects/45ddbc3ac9ff421598cbe53e1252d289/users/9918e808c77e4017a64c96ad24164b37/roles/65db0aa5d0b04764ab538efe5f356652 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 20:41:37.522491 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b228a-875e-46d4-9a00-a6828b2df3df None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:37.522878 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b228a-875e-46d4-9a00-a6828b2df3df None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:37.523058 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b228a-875e-46d4-9a00-a6828b2df3df None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:37.524726 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 297/584] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:37.530210 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58404c84-1513-4a33-a8d7-b982d7d1f28a None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:37.530498 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58404c84-1513-4a33-a8d7-b982d7d1f28a None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:37.530774 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58404c84-1513-4a33-a8d7-b982d7d1f28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:37.548159 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-58404c84-1513-4a33-a8d7-b982d7d1f28a None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:37.550029 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-58404c84-1513-4a33-a8d7-b982d7d1f28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:37.617338 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 288/585] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:41:37.642353 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b228a-875e-46d4-9a00-a6828b2df3df None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:37.753450 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b228a-875e-46d4-9a00-a6828b2df3df None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:37.789781 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4d331-55f4-4d30-9e24-c9f97380d77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:37.791301 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4d331-55f4-4d30-9e24-c9f97380d77a None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:37.791794 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4d331-55f4-4d30-9e24-c9f97380d77a None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:37.792076 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4d331-55f4-4d30-9e24-c9f97380d77a None admin] PATH_INFO: `/v3/roles/service` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:37.805417 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4d331-55f4-4d30-9e24-c9f97380d77a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:41:37.822272 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-48d4d331-55f4-4d30-9e24-c9f97380d77a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:41:37.822272 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:37.822272 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:37.822272 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:37.822272 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:37.822272 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:37.822272 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:37.822272 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:37.822272 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:37.822272 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:37.822272 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:37.822272 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:37.822272 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:41:37.822272 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:41:37.822272 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:41:37.822272 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:41:37.823175 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:41:37.823175 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:41:37.823175 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:41:37.823175 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:41:37.823175 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:37.823175 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:37.823175 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:37.823175 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:37.823175 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:37.823175 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:37.823175 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:37.823175 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:37.823175 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:37.823175 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:37.823175 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:37.823175 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:37.823982 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:37.823982 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:37.823982 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:37.823982 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:37.823982 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:41:37.823982 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:41:37.823982 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:41:37.823982 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:41:37.823982 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:41:37.823982 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:41:37.823982 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:41:37.823982 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:37.823982 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 298/586] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Apr 30 20:41:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:37.829272 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58404c84-1513-4a33-a8d7-b982d7d1f28a None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:37.929265 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58404c84-1513-4a33-a8d7-b982d7d1f28a None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:37.962628 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579dc7b7-0ef9-4939-8983-517af5ad60ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:37.963618 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579dc7b7-0ef9-4939-8983-517af5ad60ba None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:37.964095 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579dc7b7-0ef9-4939-8983-517af5ad60ba None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:37.964584 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579dc7b7-0ef9-4939-8983-517af5ad60ba None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:37.965563 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579dc7b7-0ef9-4939-8983-517af5ad60ba None admin] RBAC: Adding query filter params (name=service) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:37.966065 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579dc7b7-0ef9-4939-8983-517af5ad60ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:37.967624 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579dc7b7-0ef9-4939-8983-517af5ad60ba None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:37.979922 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 289/587] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Apr 30 20:41:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:37.985105 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4d331-55f4-4d30-9e24-c9f97380d77a None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:38.086765 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4d331-55f4-4d30-9e24-c9f97380d77a None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:38.121026 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677fea4d-cb97-4fd4-a847-ca38c435136c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:38.121891 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fea4d-cb97-4fd4-a847-ca38c435136c None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:38.122176 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fea4d-cb97-4fd4-a847-ca38c435136c None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:38.122450 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fea4d-cb97-4fd4-a847-ca38c435136c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:38.135487 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677fea4d-cb97-4fd4-a847-ca38c435136c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:38.137000 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677fea4d-cb97-4fd4-a847-ca38c435136c None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:38.155020 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-677fea4d-cb97-4fd4-a847-ca38c435136c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:38.155020 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:38.155020 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:38.155020 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:38.155020 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:38.155020 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:38.155020 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:38.155020 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:38.155020 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:38.155020 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:38.155020 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:38.155020 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:38.155020 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:41:38.155020 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:41:38.155020 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:41:38.155949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:41:38.155949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:38.155949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:38.155949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:38.155949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:38.155949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:38.155949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:38.155949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:38.155949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:38.155949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:38.155949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:38.155949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:38.155949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:38.155949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:38.155949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:38.155949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:38.155949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:38.156805 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:41:38.156805 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:41:38.156805 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:38.156805 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:38.156805 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 299/588] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:38.162627 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579dc7b7-0ef9-4939-8983-517af5ad60ba None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:38.267144 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579dc7b7-0ef9-4939-8983-517af5ad60ba None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:38.302101 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf2319-ee86-4a49-b6cd-cf02a4592f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:38.303168 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf2319-ee86-4a49-b6cd-cf02a4592f83 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:38.303648 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf2319-ee86-4a49-b6cd-cf02a4592f83 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:38.304117 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf2319-ee86-4a49-b6cd-cf02a4592f83 None admin] PATH_INFO: `/v3/domains` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:38.305061 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf2319-ee86-4a49-b6cd-cf02a4592f83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:38.305581 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf2319-ee86-4a49-b6cd-cf02a4592f83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:38.307145 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf2319-ee86-4a49-b6cd-cf02a4592f83 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:38.320776 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 290/589] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:38.328928 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677fea4d-cb97-4fd4-a847-ca38c435136c None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:38.429254 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677fea4d-cb97-4fd4-a847-ca38c435136c None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:38.466302 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19715614-6ddb-4ace-aa35-28a553625d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:38.467096 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19715614-6ddb-4ace-aa35-28a553625d27 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:38.467376 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19715614-6ddb-4ace-aa35-28a553625d27 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:38.467644 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19715614-6ddb-4ace-aa35-28a553625d27 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:38.475551 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19715614-6ddb-4ace-aa35-28a553625d27 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:38.477285 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19715614-6ddb-4ace-aa35-28a553625d27 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:38.491367 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-19715614-6ddb-4ace-aa35-28a553625d27 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 30 20:41:38.491367 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:38.491367 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:38.491367 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:38.491367 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:38.491367 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:38.491367 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:38.491367 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:38.491367 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:38.491367 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:38.491367 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:38.491367 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:38.491367 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:41:38.491367 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:41:38.491367 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:41:38.491367 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:41:38.492315 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:38.492315 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:38.492315 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:41:38.492315 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:41:38.492315 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:41:38.492315 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:41:38.492315 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:38.492315 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:38.492315 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:38.492315 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:38.492315 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:38.492315 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:38.492315 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:38.492315 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:38.492315 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:38.492315 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:38.492315 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:38.492315 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:38.493269 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:38.493269 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:38.493269 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:41:38.493269 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:41:38.493269 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:41:38.493269 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:41:38.493269 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:41:38.493269 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:41:38.493269 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Apr 30 20:41:38.493269 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:38.493269 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 300/590] 10.222.0.26 () {56 vars in 1093 bytes} [Sat Apr 30 20:41:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:38.498475 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf2319-ee86-4a49-b6cd-cf02a4592f83 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:38.601506 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf2319-ee86-4a49-b6cd-cf02a4592f83 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:38.635140 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b97ae6-b8c5-4978-ab1a-1550ce56d5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:38.635858 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b97ae6-b8c5-4978-ab1a-1550ce56d5d0 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:38.636137 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b97ae6-b8c5-4978-ab1a-1550ce56d5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:38.636603 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b97ae6-b8c5-4978-ab1a-1550ce56d5d0 None admin] PATH_INFO: `/v3/users` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:38.637460 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b97ae6-b8c5-4978-ab1a-1550ce56d5d0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:38.637768 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b97ae6-b8c5-4978-ab1a-1550ce56d5d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:38.639237 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b97ae6-b8c5-4978-ab1a-1550ce56d5d0 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:38.657478 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 291/591] 10.222.0.26 () {56 vars in 1133 bytes} [Sat Apr 30 20:41:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:38.663773 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19715614-6ddb-4ace-aa35-28a553625d27 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:38.765460 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19715614-6ddb-4ace-aa35-28a553625d27 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:38.801488 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7797df3-9028-4a98-9c2f-14919bde9c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:38.802222 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7797df3-9028-4a98-9c2f-14919bde9c1f None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:38.802420 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7797df3-9028-4a98-9c2f-14919bde9c1f None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:38.802698 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7797df3-9028-4a98-9c2f-14919bde9c1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:38.872122 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7797df3-9028-4a98-9c2f-14919bde9c1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:38.873978 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7797df3-9028-4a98-9c2f-14919bde9c1f None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:38.975434 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 301/592] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:41:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:41:38.981061 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b97ae6-b8c5-4978-ab1a-1550ce56d5d0 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:39.082629 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b97ae6-b8c5-4978-ab1a-1550ce56d5d0 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:39.119194 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0ee43-bbd8-4ece-bd1b-0dc411a230fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:39.119989 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0ee43-bbd8-4ece-bd1b-0dc411a230fc None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:39.120270 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0ee43-bbd8-4ece-bd1b-0dc411a230fc None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:39.120547 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0ee43-bbd8-4ece-bd1b-0dc411a230fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:39.132244 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f0ee43-bbd8-4ece-bd1b-0dc411a230fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:39.133794 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f0ee43-bbd8-4ece-bd1b-0dc411a230fc None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:39.153605 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-22f0ee43-bbd8-4ece-bd1b-0dc411a230fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:39.153605 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:39.153605 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:39.153605 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:39.153605 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:39.153605 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:39.153605 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:39.153605 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:39.153605 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:39.153605 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:39.153605 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:39.153605 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:39.153605 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:41:39.153605 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:41:39.153605 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:41:39.154558 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:41:39.154558 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:39.154558 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:39.154558 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:39.154558 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:39.154558 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:39.154558 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:39.154558 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:39.154558 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:39.154558 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:39.154558 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:39.154558 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:39.154558 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:39.154558 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:39.154558 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:39.154558 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:39.154558 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:39.155448 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:41:39.155448 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:41:39.155448 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:39.155448 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:39.155448 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 292/593] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:39.161491 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7797df3-9028-4a98-9c2f-14919bde9c1f None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:39.261479 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7797df3-9028-4a98-9c2f-14919bde9c1f None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:39.296291 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07299a71-cfe5-4cbf-bfa1-460d738b22e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:39.297422 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07299a71-cfe5-4cbf-bfa1-460d738b22e1 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:39.297931 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07299a71-cfe5-4cbf-bfa1-460d738b22e1 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:39.298930 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07299a71-cfe5-4cbf-bfa1-460d738b22e1 None admin] PATH_INFO: `/v3/domains` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:39.299847 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07299a71-cfe5-4cbf-bfa1-460d738b22e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:39.300366 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07299a71-cfe5-4cbf-bfa1-460d738b22e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:39.302057 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07299a71-cfe5-4cbf-bfa1-460d738b22e1 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:39.314508 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 302/594] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:39.325024 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0ee43-bbd8-4ece-bd1b-0dc411a230fc None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:39.341080 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e897804-6262-4f18-abdc-b2b4ccf8e974 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:39.341352 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e897804-6262-4f18-abdc-b2b4ccf8e974 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:39.341574 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e897804-6262-4f18-abdc-b2b4ccf8e974 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:39.343829 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 303/595] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:41:39.349101 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325308c-aada-45f9-8899-d1192a1ef96b None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:39.349396 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325308c-aada-45f9-8899-d1192a1ef96b None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:39.349680 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325308c-aada-45f9-8899-d1192a1ef96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:39.369599 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-6325308c-aada-45f9-8899-d1192a1ef96b None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:39.370870 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-6325308c-aada-45f9-8899-d1192a1ef96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:39.449174 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0ee43-bbd8-4ece-bd1b-0dc411a230fc None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:39.457910 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 304/596] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:41:39.487537 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325308c-aada-45f9-8899-d1192a1ef96b None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:39.495527 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e937001-d62b-4b39-ab52-f5a28a8bdda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:39.496738 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e937001-d62b-4b39-ab52-f5a28a8bdda7 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:39.497044 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e937001-d62b-4b39-ab52-f5a28a8bdda7 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:39.497318 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e937001-d62b-4b39-ab52-f5a28a8bdda7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:39.506977 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e937001-d62b-4b39-ab52-f5a28a8bdda7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:39.508429 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e937001-d62b-4b39-ab52-f5a28a8bdda7 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:39.526081 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-1e937001-d62b-4b39-ab52-f5a28a8bdda7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:41:39.526081 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:39.526081 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:39.526081 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:39.526081 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:39.526081 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:39.526081 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:39.526081 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:39.526081 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:39.526081 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:39.526081 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:39.526081 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:39.526081 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:41:39.526081 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:41:39.526081 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:41:39.527086 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:41:39.527086 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:39.527086 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:39.527086 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:39.527086 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:39.527086 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:39.527086 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:39.527086 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:39.527086 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:39.527086 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:39.527086 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:39.527086 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:39.527086 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:39.527086 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:39.527086 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:39.527086 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:39.527086 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:39.528005 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:41:39.528005 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:41:39.528005 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:41:39.528005 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:41:39.528005 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:41:39.528005 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:41:39.528005 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:41:39.528005 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:39.528005 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 293/597] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:41:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:39.533349 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e937001-d62b-4b39-ab52-f5a28a8bdda7 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:39.597852 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325308c-aada-45f9-8899-d1192a1ef96b None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:39.631192 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdc56e-93e5-40cf-9459-185b2ea3d136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:39.631988 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdc56e-93e5-40cf-9459-185b2ea3d136 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:39.632270 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdc56e-93e5-40cf-9459-185b2ea3d136 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:39.632545 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdc56e-93e5-40cf-9459-185b2ea3d136 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:39.640323 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e937001-d62b-4b39-ab52-f5a28a8bdda7 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:39.644513 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebdc56e-93e5-40cf-9459-185b2ea3d136 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:41:39.652230 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-eebdc56e-93e5-40cf-9459-185b2ea3d136 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:41:39.652230 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:39.652230 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:39.652230 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:39.652230 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:39.652230 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:39.652230 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:39.652230 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:39.652230 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:39.652230 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:39.652230 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:39.652230 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:39.652230 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:41:39.652230 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:41:39.652230 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:41:39.652230 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:41:39.653392 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:41:39.653392 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:41:39.653392 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:41:39.653392 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:41:39.653392 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:39.653392 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:39.653392 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:39.653392 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:39.653392 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:39.653392 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:39.653392 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:39.653392 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:39.653392 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:39.653392 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:39.653392 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:39.653392 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:39.654331 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:39.654331 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:39.654331 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:39.654331 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:39.654331 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:41:39.654331 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:41:39.654331 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:41:39.654331 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:41:39.654331 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:41:39.654331 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:41:39.654331 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:41:39.654331 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:39.654331 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 305/598] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Apr 30 20:41:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:39.659453 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af12fdd-9759-41a7-8546-6c808b195d5c None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:39.659748 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af12fdd-9759-41a7-8546-6c808b195d5c None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:39.660026 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af12fdd-9759-41a7-8546-6c808b195d5c None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:39.661485 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 306/599] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:39.665840 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af12fdd-9759-41a7-8546-6c808b195d5c None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:39.678604 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346796d0-0346-47b8-a9d0-25473c1fac17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:39.679261 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346796d0-0346-47b8-a9d0-25473c1fac17 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:39.679542 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346796d0-0346-47b8-a9d0-25473c1fac17 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:39.679815 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346796d0-0346-47b8-a9d0-25473c1fac17 None admin] PATH_INFO: `/v3/projects` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:39.681299 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346796d0-0346-47b8-a9d0-25473c1fac17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:39.681299 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346796d0-0346-47b8-a9d0-25473c1fac17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:39.682346 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346796d0-0346-47b8-a9d0-25473c1fac17 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:39.700018 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 294/600] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Apr 30 20:41:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:41:39.700018 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732113ab-afad-4937-99de-fd070c1543da None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:39.700018 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732113ab-afad-4937-99de-fd070c1543da None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:39.700018 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732113ab-afad-4937-99de-fd070c1543da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:39.713556 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-732113ab-afad-4937-99de-fd070c1543da None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:39.714695 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-732113ab-afad-4937-99de-fd070c1543da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:39.775393 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af12fdd-9759-41a7-8546-6c808b195d5c None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:39.784838 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 295/601] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:41:39.785736 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732113ab-afad-4937-99de-fd070c1543da None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:39.810449 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5aaca-2425-47d8-a11d-b49b4a751331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:39.811200 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5aaca-2425-47d8-a11d-b49b4a751331 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:39.811538 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5aaca-2425-47d8-a11d-b49b4a751331 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:39.811799 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5aaca-2425-47d8-a11d-b49b4a751331 None admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:39.812481 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5aaca-2425-47d8-a11d-b49b4a751331 None admin] RBAC: Adding query filter params (name=service) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:39.812794 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5aaca-2425-47d8-a11d-b49b4a751331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:39.814946 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5aaca-2425-47d8-a11d-b49b4a751331 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:39.823142 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 307/602] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Apr 30 20:41:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:39.824414 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65878283-d420-4fd7-92d3-3abdb9578e37 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:39.824703 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65878283-d420-4fd7-92d3-3abdb9578e37 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:39.825017 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65878283-d420-4fd7-92d3-3abdb9578e37 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:39.826410 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 308/603] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:39.826944 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65878283-d420-4fd7-92d3-3abdb9578e37 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:39.886581 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732113ab-afad-4937-99de-fd070c1543da None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:39.918329 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625f62a-327d-4733-8d6e-e8016b86e128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:39.918972 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625f62a-327d-4733-8d6e-e8016b86e128 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:39.919250 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625f62a-327d-4733-8d6e-e8016b86e128 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:39.919614 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625f62a-327d-4733-8d6e-e8016b86e128 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:39.920435 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625f62a-327d-4733-8d6e-e8016b86e128 None admin] RBAC: Adding query filter params (role.id=65db0aa5d0b04764ab538efe5f356652, scope.project.id=45ddbc3ac9ff421598cbe53e1252d289, user.id=2aee3a7a6b4b4d489993c131f3ae2048) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:39.920751 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625f62a-327d-4733-8d6e-e8016b86e128 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:39.922188 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625f62a-327d-4733-8d6e-e8016b86e128 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:39.924506 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65878283-d420-4fd7-92d3-3abdb9578e37 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:39.927894 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 296/604] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Apr 30 20:41:39 2022] GET /identity/v3/role_assignments?user.id=2aee3a7a6b4b4d489993c131f3ae2048&scope.project.id=45ddbc3ac9ff421598cbe53e1252d289&role.id=65db0aa5d0b04764ab538efe5f356652 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:39.928660 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625f62a-327d-4733-8d6e-e8016b86e128 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:39.961028 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681377f-74b3-4b24-9afc-c02b67a85957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:39.962479 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681377f-74b3-4b24-9afc-c02b67a85957 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:39.962769 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681377f-74b3-4b24-9afc-c02b67a85957 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:39.963045 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681377f-74b3-4b24-9afc-c02b67a85957 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:39.978848 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f681377f-74b3-4b24-9afc-c02b67a85957 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:41:39.987470 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-f681377f-74b3-4b24-9afc-c02b67a85957 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:41:39.987470 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:39.987470 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:39.987470 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:39.987470 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:39.987470 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:39.987470 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:39.987470 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:39.987470 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:39.987470 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:39.987470 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:39.987470 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:39.987470 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:41:39.987470 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:41:39.987470 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:41:39.987470 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:41:39.988489 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:41:39.988489 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:41:39.988489 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:41:39.988489 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:41:39.988489 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:39.988489 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:39.988489 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:39.988489 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:39.988489 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:39.988489 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:39.988489 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:39.988489 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:39.988489 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:39.988489 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:39.988489 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:39.988489 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:39.989382 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:39.989382 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:39.989382 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:39.989382 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:39.989382 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:41:39.989382 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:41:39.989382 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:41:39.989382 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:41:39.989382 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:41:39.989382 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:41:39.989382 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:41:39.989382 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:39.992955 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 309/605] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Apr 30 20:41:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:39.992955 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d8563-456c-4abe-9a39-25966f1788ef None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:39.992955 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d8563-456c-4abe-9a39-25966f1788ef None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:39.992955 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d8563-456c-4abe-9a39-25966f1788ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:40.011546 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-9e9d8563-456c-4abe-9a39-25966f1788ef None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:40.013067 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-9e9d8563-456c-4abe-9a39-25966f1788ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:40.035768 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625f62a-327d-4733-8d6e-e8016b86e128 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:40.071110 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1e836-7276-434a-b0f3-94b944df4583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:40.071933 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1e836-7276-434a-b0f3-94b944df4583 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:40.072213 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1e836-7276-434a-b0f3-94b944df4583 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:40.072489 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1e836-7276-434a-b0f3-94b944df4583 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:40.084304 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1e836-7276-434a-b0f3-94b944df4583 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:40.097241 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 310/606] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:41:40.097443 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1e836-7276-434a-b0f3-94b944df4583 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:40.097523 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d8563-456c-4abe-9a39-25966f1788ef None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:40.116620 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-4ee1e836-7276-434a-b0f3-94b944df4583 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:40.116620 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:40.116620 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:40.116620 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:40.116620 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:40.116620 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:40.116620 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:40.116620 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:40.116620 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:40.116620 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:40.116620 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:40.116620 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:40.116620 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:41:40.116620 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:41:40.116620 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:41:40.117742 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:41:40.117742 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:40.117742 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:40.117742 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:40.117742 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:40.117742 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:40.117742 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:40.117742 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:40.117742 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:40.117742 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:40.117742 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:40.117742 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:40.117742 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:40.117742 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:40.117742 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:40.117742 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:40.117742 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:40.124061 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:41:40.124061 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:41:40.124061 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:40.124061 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:40.124061 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 297/607] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:40.124061 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1e836-7276-434a-b0f3-94b944df4583 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:40.192884 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d8563-456c-4abe-9a39-25966f1788ef None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:40.221524 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1e836-7276-434a-b0f3-94b944df4583 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:40.230221 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa9960-7755-4cab-b6c5-22c88e9044ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:40.230896 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa9960-7755-4cab-b6c5-22c88e9044ea None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:40.231179 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa9960-7755-4cab-b6c5-22c88e9044ea None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:40.231454 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa9960-7755-4cab-b6c5-22c88e9044ea None admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:40.232191 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa9960-7755-4cab-b6c5-22c88e9044ea None admin] RBAC: Adding query filter params (name=service) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:40.232518 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa9960-7755-4cab-b6c5-22c88e9044ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:40.233962 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa9960-7755-4cab-b6c5-22c88e9044ea None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:40.242449 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 311/608] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Apr 30 20:41:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:40.243463 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa9960-7755-4cab-b6c5-22c88e9044ea None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:40.257829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a9537-c6af-4eb8-b784-8b636ba1e8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:40.259193 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a9537-c6af-4eb8-b784-8b636ba1e8e2 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:40.259480 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a9537-c6af-4eb8-b784-8b636ba1e8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:40.259752 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a9537-c6af-4eb8-b784-8b636ba1e8e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:40.272001 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a9537-c6af-4eb8-b784-8b636ba1e8e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:41:40.279757 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-e06a9537-c6af-4eb8-b784-8b636ba1e8e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:41:40.279757 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:40.279757 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:40.279757 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:40.279757 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:40.279757 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:40.279757 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:40.279757 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:40.279757 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:40.279757 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:40.279757 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:40.279757 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:40.279757 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:41:40.279757 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:41:40.279757 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:41:40.279757 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:41:40.280829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:41:40.280829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:41:40.280829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:41:40.280829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:41:40.280829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:40.280829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:40.280829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:40.280829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:40.280829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:40.280829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:40.280829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:40.280829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:40.280829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:40.280829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:40.280829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:40.280829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:40.281855 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:40.281855 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:40.281855 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:40.281855 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:40.281855 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:41:40.281855 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:41:40.281855 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:41:40.281855 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:41:40.281855 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:41:40.281855 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:41:40.281855 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:41:40.281855 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:40.281855 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 298/609] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Apr 30 20:41:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:40.281855 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a9537-c6af-4eb8-b784-8b636ba1e8e2 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:40.347086 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa9960-7755-4cab-b6c5-22c88e9044ea None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:40.379741 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a9537-c6af-4eb8-b784-8b636ba1e8e2 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:40.381229 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d5c37-b030-451a-bb65-0bbba21d67b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:40.382790 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d5c37-b030-451a-bb65-0bbba21d67b4 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:40.383099 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d5c37-b030-451a-bb65-0bbba21d67b4 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:40.383382 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d5c37-b030-451a-bb65-0bbba21d67b4 None admin] PATH_INFO: `/v3/domains` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:40.384105 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d5c37-b030-451a-bb65-0bbba21d67b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:40.384415 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d5c37-b030-451a-bb65-0bbba21d67b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:40.385819 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d5c37-b030-451a-bb65-0bbba21d67b4 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:40.400958 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 312/610] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:40.400958 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d5c37-b030-451a-bb65-0bbba21d67b4 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:40.418236 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6277d-11e4-48d2-8222-e06879c84f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:40.419029 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6277d-11e4-48d2-8222-e06879c84f29 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:40.419308 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6277d-11e4-48d2-8222-e06879c84f29 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:40.419582 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6277d-11e4-48d2-8222-e06879c84f29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:40.430360 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6277d-11e4-48d2-8222-e06879c84f29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:40.431793 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6277d-11e4-48d2-8222-e06879c84f29 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:40.449213 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-87b6277d-11e4-48d2-8222-e06879c84f29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:40.449213 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:40.449213 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:40.449213 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:40.449213 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:40.449213 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:40.449213 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:40.449213 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:40.449213 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:40.449213 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:40.449213 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:40.449213 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:40.449213 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:41:40.449213 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:41:40.449213 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:41:40.450243 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:41:40.450243 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:40.450243 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:40.450243 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:40.450243 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:40.450243 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:40.450243 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:40.450243 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:40.450243 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:40.450243 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:40.450243 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:40.450243 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:40.450243 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:40.450243 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:40.450243 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:40.450243 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:40.450243 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:40.451134 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:41:40.451134 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:41:40.451134 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:40.451134 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:40.451134 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 299/611] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:40.451134 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6277d-11e4-48d2-8222-e06879c84f29 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:40.510516 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d5c37-b030-451a-bb65-0bbba21d67b4 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:40.545510 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59588c8a-b7f9-4d0e-a96d-14a9d24ebc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:40.546171 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59588c8a-b7f9-4d0e-a96d-14a9d24ebc33 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:40.546519 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59588c8a-b7f9-4d0e-a96d-14a9d24ebc33 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:40.546734 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59588c8a-b7f9-4d0e-a96d-14a9d24ebc33 None admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:40.547459 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59588c8a-b7f9-4d0e-a96d-14a9d24ebc33 None admin] RBAC: Adding query filter params (name=service) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:40.547768 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59588c8a-b7f9-4d0e-a96d-14a9d24ebc33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:40.549978 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59588c8a-b7f9-4d0e-a96d-14a9d24ebc33 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:40.550672 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6277d-11e4-48d2-8222-e06879c84f29 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:40.561960 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 313/612] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Apr 30 20:41:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:40.561960 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59588c8a-b7f9-4d0e-a96d-14a9d24ebc33 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:40.586927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b699ac-dc68-4812-b2e2-1be6438844c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:40.587827 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b699ac-dc68-4812-b2e2-1be6438844c9 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:40.588173 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b699ac-dc68-4812-b2e2-1be6438844c9 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:40.588511 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b699ac-dc68-4812-b2e2-1be6438844c9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:40.596488 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b699ac-dc68-4812-b2e2-1be6438844c9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:40.598079 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b699ac-dc68-4812-b2e2-1be6438844c9 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:40.616787 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-99b699ac-dc68-4812-b2e2-1be6438844c9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 30 20:41:40.616787 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:40.616787 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:40.616787 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:40.616787 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:40.616787 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:40.616787 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:40.616787 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:40.616787 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:40.616787 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:40.616787 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:40.616787 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:40.616787 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:41:40.616787 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:41:40.616787 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:41:40.616787 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:41:40.617938 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:40.617938 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:40.617938 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:41:40.617938 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:41:40.617938 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:41:40.617938 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:41:40.617938 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:40.617938 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:40.617938 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:40.617938 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:40.617938 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:40.617938 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:40.617938 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:40.617938 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:40.617938 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:40.617938 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:40.617938 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:40.617938 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:40.623460 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:40.623460 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:40.623460 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:41:40.623460 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:41:40.623460 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:41:40.623460 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:41:40.623460 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:41:40.623460 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:41:40.623460 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Apr 30 20:41:40.623460 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:40.623460 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 300/613] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:41:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:40.623460 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b699ac-dc68-4812-b2e2-1be6438844c9 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:40.655952 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59588c8a-b7f9-4d0e-a96d-14a9d24ebc33 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:40.689646 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab624ee-f7c2-40e8-8e20-b4728f6ec983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:40.690414 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab624ee-f7c2-40e8-8e20-b4728f6ec983 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:40.690693 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab624ee-f7c2-40e8-8e20-b4728f6ec983 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:40.690960 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab624ee-f7c2-40e8-8e20-b4728f6ec983 None admin] PATH_INFO: `/v3/domains` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:40.691673 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab624ee-f7c2-40e8-8e20-b4728f6ec983 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:40.691979 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab624ee-f7c2-40e8-8e20-b4728f6ec983 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:40.693389 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab624ee-f7c2-40e8-8e20-b4728f6ec983 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:40.705991 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 314/614] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:40.706771 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab624ee-f7c2-40e8-8e20-b4728f6ec983 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:40.726752 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b699ac-dc68-4812-b2e2-1be6438844c9 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:40.759527 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa474ef-c360-45b4-b342-cd1616d4eecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:40.760689 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa474ef-c360-45b4-b342-cd1616d4eecb None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:40.761250 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa474ef-c360-45b4-b342-cd1616d4eecb None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:40.761626 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa474ef-c360-45b4-b342-cd1616d4eecb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:40.773031 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa474ef-c360-45b4-b342-cd1616d4eecb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:40.774624 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa474ef-c360-45b4-b342-cd1616d4eecb None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:40.791368 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-baa474ef-c360-45b4-b342-cd1616d4eecb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:40.791368 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:40.791368 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:40.791368 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:40.791368 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:40.791368 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:40.791368 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:40.791368 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:40.791368 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:40.791368 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:40.791368 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:40.791368 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:40.791368 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:41:40.791368 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:41:40.791368 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:41:40.792459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:41:40.792459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:40.792459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:40.792459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:40.792459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:40.792459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:40.792459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:40.792459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:40.792459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:40.792459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:40.792459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:40.792459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:40.792459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:40.792459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:40.792459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:40.792459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:40.792459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:40.793603 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:41:40.793603 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:41:40.793603 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:40.793603 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:40.799882 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 301/615] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:40.799882 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa474ef-c360-45b4-b342-cd1616d4eecb None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:40.803768 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab624ee-f7c2-40e8-8e20-b4728f6ec983 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:40.838139 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2b5b3-051b-4a5a-812b-5793985e46ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:40.838846 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2b5b3-051b-4a5a-812b-5793985e46ff None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:40.839080 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2b5b3-051b-4a5a-812b-5793985e46ff None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:40.839352 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2b5b3-051b-4a5a-812b-5793985e46ff None admin] PATH_INFO: `/v3/users` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:40.840167 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2b5b3-051b-4a5a-812b-5793985e46ff None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:40.840470 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2b5b3-051b-4a5a-812b-5793985e46ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:40.841949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2b5b3-051b-4a5a-812b-5793985e46ff None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:40.859226 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 315/616] 10.222.0.26 () {56 vars in 1137 bytes} [Sat Apr 30 20:41:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:40.859226 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2b5b3-051b-4a5a-812b-5793985e46ff None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:40.910790 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa474ef-c360-45b4-b342-cd1616d4eecb None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:40.943611 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48193d-218b-4d8d-9405-296de8dcee51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:40.944570 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48193d-218b-4d8d-9405-296de8dcee51 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:40.945011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48193d-218b-4d8d-9405-296de8dcee51 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:40.945388 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48193d-218b-4d8d-9405-296de8dcee51 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:40.952889 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48193d-218b-4d8d-9405-296de8dcee51 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:40.954955 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48193d-218b-4d8d-9405-296de8dcee51 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:40.956690 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2b5b3-051b-4a5a-812b-5793985e46ff None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:40.971659 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-bb48193d-218b-4d8d-9405-296de8dcee51 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 30 20:41:40.971659 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:40.971659 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:40.971659 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:40.971659 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:40.971659 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:40.971659 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:40.971659 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:40.971659 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:40.971659 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:40.971659 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:40.971659 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:40.971659 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:41:40.971659 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:41:40.971659 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:41:40.971659 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:41:40.972832 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:40.972832 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:40.972832 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:41:40.972832 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:41:40.972832 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:41:40.972832 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:41:40.972832 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:40.972832 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:40.972832 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:40.972832 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:40.972832 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:40.972832 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:40.972832 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:40.972832 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:40.972832 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:40.972832 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:40.972832 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:40.972832 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:40.974097 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:40.974097 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:40.974097 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:41:40.974097 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:41:40.974097 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:41:40.974097 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:41:40.974097 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:41:40.974097 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:41:40.974097 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Apr 30 20:41:40.974097 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:40.980394 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 302/617] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:41:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:40.980394 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48193d-218b-4d8d-9405-296de8dcee51 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:40.991609 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4411b2-93e2-4bfc-85c3-f3ac67218776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:40.992271 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4411b2-93e2-4bfc-85c3-f3ac67218776 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:40.992555 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4411b2-93e2-4bfc-85c3-f3ac67218776 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:40.992933 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4411b2-93e2-4bfc-85c3-f3ac67218776 None admin] PATH_INFO: `/v3/domains` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:40.993567 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4411b2-93e2-4bfc-85c3-f3ac67218776 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:40.993877 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4411b2-93e2-4bfc-85c3-f3ac67218776 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:40.995531 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4411b2-93e2-4bfc-85c3-f3ac67218776 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:41.006681 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 316/618] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:41.007653 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4411b2-93e2-4bfc-85c3-f3ac67218776 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:41.077287 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48193d-218b-4d8d-9405-296de8dcee51 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:41.103545 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4411b2-93e2-4bfc-85c3-f3ac67218776 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:41.111254 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee984b-b5fb-480c-9c0b-31e1dc906b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:41.112109 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee984b-b5fb-480c-9c0b-31e1dc906b26 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:41.112588 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee984b-b5fb-480c-9c0b-31e1dc906b26 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:41.112863 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee984b-b5fb-480c-9c0b-31e1dc906b26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:41.136761 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae3453-3d85-41a4-88e5-e59115b9aa5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:41.137602 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae3453-3d85-41a4-88e5-e59115b9aa5d None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:41.137984 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae3453-3d85-41a4-88e5-e59115b9aa5d None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:41.138375 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae3453-3d85-41a4-88e5-e59115b9aa5d None admin] PATH_INFO: `/v3/users` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:41.139303 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae3453-3d85-41a4-88e5-e59115b9aa5d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:41.139962 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae3453-3d85-41a4-88e5-e59115b9aa5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:41.141286 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae3453-3d85-41a4-88e5-e59115b9aa5d None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:41.158974 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 317/619] 10.222.0.26 () {56 vars in 1137 bytes} [Sat Apr 30 20:41:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:41.159777 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae3453-3d85-41a4-88e5-e59115b9aa5d None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:41.179527 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee984b-b5fb-480c-9c0b-31e1dc906b26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:41.181033 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee984b-b5fb-480c-9c0b-31e1dc906b26 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:41.260228 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae3453-3d85-41a4-88e5-e59115b9aa5d None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:41.282279 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 303/620] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:41:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:41:41.283531 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee984b-b5fb-480c-9c0b-31e1dc906b26 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:41.299797 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b497c-8801-4865-94a4-72ee15fe75e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:41.300650 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b497c-8801-4865-94a4-72ee15fe75e1 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:41.300959 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b497c-8801-4865-94a4-72ee15fe75e1 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:41.301239 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b497c-8801-4865-94a4-72ee15fe75e1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:41.308512 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b497c-8801-4865-94a4-72ee15fe75e1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:41.310013 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b497c-8801-4865-94a4-72ee15fe75e1 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:41.324655 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-587b497c-8801-4865-94a4-72ee15fe75e1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 30 20:41:41.324655 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:41.324655 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:41.324655 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:41.324655 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:41.324655 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:41.324655 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:41.324655 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:41.324655 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:41.324655 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:41.324655 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:41.324655 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:41.324655 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:41:41.324655 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:41:41.324655 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:41:41.324655 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:41:41.325823 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:41.325823 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:41.325823 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:41:41.325823 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:41:41.325823 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:41:41.325823 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:41:41.325823 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:41.325823 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:41.325823 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:41.325823 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:41.325823 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:41.325823 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:41.325823 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:41.325823 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:41.325823 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:41.325823 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:41.325823 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:41.325823 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:41.326769 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:41.326769 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:41.326769 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:41:41.326769 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:41:41.326769 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:41:41.326769 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:41:41.326769 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:41:41.326769 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:41:41.326769 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Apr 30 20:41:41.326769 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:41.329217 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 318/621] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Apr 30 20:41:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:41.330777 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b497c-8801-4865-94a4-72ee15fe75e1 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:41.381331 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee984b-b5fb-480c-9c0b-31e1dc906b26 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:41.416080 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7769363-32cd-43c5-aa1a-f7f8472535b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:41.416729 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7769363-32cd-43c5-aa1a-f7f8472535b3 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:41.417042 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7769363-32cd-43c5-aa1a-f7f8472535b3 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:41.417322 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7769363-32cd-43c5-aa1a-f7f8472535b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:41.435674 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b497c-8801-4865-94a4-72ee15fe75e1 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:41.468766 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2e48a-3c8d-4412-9fb8-d490dd0a69bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:41.469591 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2e48a-3c8d-4412-9fb8-d490dd0a69bc None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:41.469868 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2e48a-3c8d-4412-9fb8-d490dd0a69bc None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:41.470744 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2e48a-3c8d-4412-9fb8-d490dd0a69bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:41.480785 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf2e48a-3c8d-4412-9fb8-d490dd0a69bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:41.482303 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf2e48a-3c8d-4412-9fb8-d490dd0a69bc None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:41.488539 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7769363-32cd-43c5-aa1a-f7f8472535b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:41.490250 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7769363-32cd-43c5-aa1a-f7f8472535b3 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:41.499251 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-ddf2e48a-3c8d-4412-9fb8-d490dd0a69bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:41.499251 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:41.499251 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:41.499251 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:41.499251 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:41.499251 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:41.499251 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:41.499251 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:41.499251 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:41.499251 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:41.499251 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:41.499251 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:41.499251 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:41:41.499251 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:41:41.499251 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:41:41.500311 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:41:41.500311 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:41.500311 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:41.500311 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:41.500311 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:41.500311 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:41.500311 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:41.500311 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:41.500311 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:41.500311 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:41.500311 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:41.500311 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:41.500311 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:41.500311 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:41.500311 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:41.500311 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:41.500311 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:41.502165 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:41:41.502165 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:41:41.502165 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:41.502165 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:41.505392 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 319/622] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:41.506151 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2e48a-3c8d-4412-9fb8-d490dd0a69bc None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:41.598257 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 304/623] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:41:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:41:41.598257 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7769363-32cd-43c5-aa1a-f7f8472535b3 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:41.611981 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2e48a-3c8d-4412-9fb8-d490dd0a69bc None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:41.646263 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195f8ef-dc37-47fb-a135-441ab39eaafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:41.646939 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195f8ef-dc37-47fb-a135-441ab39eaafd None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:41.647229 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195f8ef-dc37-47fb-a135-441ab39eaafd None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:41.647490 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195f8ef-dc37-47fb-a135-441ab39eaafd None admin] PATH_INFO: `/v3/users` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:41.648316 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195f8ef-dc37-47fb-a135-441ab39eaafd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:41.648641 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195f8ef-dc37-47fb-a135-441ab39eaafd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:41.650104 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195f8ef-dc37-47fb-a135-441ab39eaafd None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:41.667494 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 320/624] 10.222.0.26 () {56 vars in 1139 bytes} [Sat Apr 30 20:41:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:41.668281 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195f8ef-dc37-47fb-a135-441ab39eaafd None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:41.695394 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7769363-32cd-43c5-aa1a-f7f8472535b3 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:41.730593 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136babb4-ed3c-4eae-bbad-6d1422b49556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:41.731262 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136babb4-ed3c-4eae-bbad-6d1422b49556 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:41.731547 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136babb4-ed3c-4eae-bbad-6d1422b49556 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:41.731822 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136babb4-ed3c-4eae-bbad-6d1422b49556 None admin] PATH_INFO: `/v3/domains` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:41.732534 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136babb4-ed3c-4eae-bbad-6d1422b49556 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:41.732842 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136babb4-ed3c-4eae-bbad-6d1422b49556 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:41.734260 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136babb4-ed3c-4eae-bbad-6d1422b49556 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:41.752044 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 305/625] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:41:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:41.752044 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136babb4-ed3c-4eae-bbad-6d1422b49556 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:41.772539 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195f8ef-dc37-47fb-a135-441ab39eaafd None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:41.806987 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be111326-1b67-43ad-a961-9757a89bcc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:41.807864 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be111326-1b67-43ad-a961-9757a89bcc24 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:41.808224 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be111326-1b67-43ad-a961-9757a89bcc24 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:41.808504 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be111326-1b67-43ad-a961-9757a89bcc24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:41.819838 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be111326-1b67-43ad-a961-9757a89bcc24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:41.821374 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be111326-1b67-43ad-a961-9757a89bcc24 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:41.840079 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-be111326-1b67-43ad-a961-9757a89bcc24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:41.840079 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:41.840079 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:41.840079 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:41.840079 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:41.840079 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:41.840079 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:41.840079 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:41.840079 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:41.840079 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:41.840079 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:41.840079 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:41.840079 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:41:41.840079 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:41:41.840079 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:41:41.841491 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:41:41.841491 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:41.841491 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:41.841491 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:41.841491 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:41.841491 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:41.841491 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:41.841491 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:41.841491 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:41.841491 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:41.841491 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:41.841491 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:41.841491 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:41.841491 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:41.841491 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:41.841491 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:41.841491 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:41.842841 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:41:41.842841 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:41:41.842841 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:41.842841 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:41.842841 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 321/626] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:41.842841 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be111326-1b67-43ad-a961-9757a89bcc24 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:41.859585 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136babb4-ed3c-4eae-bbad-6d1422b49556 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:41.893724 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da507961-0da0-4736-8288-1f30a3ee38b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:41.894375 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da507961-0da0-4736-8288-1f30a3ee38b1 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:41.894655 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da507961-0da0-4736-8288-1f30a3ee38b1 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:41.894933 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da507961-0da0-4736-8288-1f30a3ee38b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:41.945810 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be111326-1b67-43ad-a961-9757a89bcc24 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:41.959968 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da507961-0da0-4736-8288-1f30a3ee38b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:41.961459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da507961-0da0-4736-8288-1f30a3ee38b1 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:41.979823 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdc6d4-264b-4eef-ab77-332814aefba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:41.980617 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdc6d4-264b-4eef-ab77-332814aefba8 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:41.980900 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdc6d4-264b-4eef-ab77-332814aefba8 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:41.981205 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdc6d4-264b-4eef-ab77-332814aefba8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:41.988500 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fdc6d4-264b-4eef-ab77-332814aefba8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:41.989975 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fdc6d4-264b-4eef-ab77-332814aefba8 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:42.004125 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-a5fdc6d4-264b-4eef-ab77-332814aefba8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:41:42.004125 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:42.004125 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:42.004125 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:42.004125 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:42.004125 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:42.004125 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:42.004125 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:42.004125 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:42.004125 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:42.004125 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:42.004125 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:42.004125 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:41:42.004125 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:41:42.004125 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:41:42.005057 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:41:42.005057 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:42.005057 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:42.005057 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:42.005057 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:42.005057 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:42.005057 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:42.005057 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:42.005057 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:42.005057 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:42.005057 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:42.005057 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:42.005057 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:42.005057 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:42.005057 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:42.005057 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:42.005057 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:42.010862 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:41:42.010862 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:41:42.010862 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:41:42.010862 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:41:42.010862 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:41:42.010862 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:41:42.010862 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:41:42.010862 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:42.010862 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 322/627] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:41:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:42.010862 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdc6d4-264b-4eef-ab77-332814aefba8 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:42.065280 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 306/628] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:41:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:41:42.065280 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da507961-0da0-4736-8288-1f30a3ee38b1 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:42.108185 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdc6d4-264b-4eef-ab77-332814aefba8 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:42.140996 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df80e90-c4e2-4c4c-aefd-4b0b7b243586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:42.141637 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df80e90-c4e2-4c4c-aefd-4b0b7b243586 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:42.142152 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df80e90-c4e2-4c4c-aefd-4b0b7b243586 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:42.142433 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df80e90-c4e2-4c4c-aefd-4b0b7b243586 None admin] PATH_INFO: `/v3/domains` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:42.143147 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df80e90-c4e2-4c4c-aefd-4b0b7b243586 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:42.143450 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df80e90-c4e2-4c4c-aefd-4b0b7b243586 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:42.144828 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df80e90-c4e2-4c4c-aefd-4b0b7b243586 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:42.163116 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 323/629] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:42.163116 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df80e90-c4e2-4c4c-aefd-4b0b7b243586 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:42.163376 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da507961-0da0-4736-8288-1f30a3ee38b1 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:42.198181 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d8330-de6f-43e5-a6a1-fdf391920847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:42.198835 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d8330-de6f-43e5-a6a1-fdf391920847 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:42.199108 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d8330-de6f-43e5-a6a1-fdf391920847 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:42.199378 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d8330-de6f-43e5-a6a1-fdf391920847 None admin] PATH_INFO: `/v3/projects` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:42.200456 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d8330-de6f-43e5-a6a1-fdf391920847 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:42.200456 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d8330-de6f-43e5-a6a1-fdf391920847 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:42.201914 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d8330-de6f-43e5-a6a1-fdf391920847 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:42.213509 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 307/630] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Apr 30 20:41:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:42.214314 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d8330-de6f-43e5-a6a1-fdf391920847 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:42.268717 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df80e90-c4e2-4c4c-aefd-4b0b7b243586 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:42.302999 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616c607-5916-4e31-baa7-ba75bfdee04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:42.304098 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616c607-5916-4e31-baa7-ba75bfdee04e None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:42.304376 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616c607-5916-4e31-baa7-ba75bfdee04e None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:42.304644 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616c607-5916-4e31-baa7-ba75bfdee04e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:42.315293 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616c607-5916-4e31-baa7-ba75bfdee04e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:42.316759 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616c607-5916-4e31-baa7-ba75bfdee04e None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:42.319368 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d8330-de6f-43e5-a6a1-fdf391920847 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:42.333788 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-c616c607-5916-4e31-baa7-ba75bfdee04e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:42.333788 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:42.333788 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:42.333788 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:42.333788 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:42.333788 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:42.333788 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:42.333788 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:42.333788 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:42.333788 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:42.333788 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:42.333788 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:42.333788 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:41:42.333788 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:41:42.333788 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:41:42.334684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:41:42.334684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:42.334684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:42.334684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:42.334684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:42.334684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:42.334684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:42.334684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:42.334684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:42.334684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:42.334684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:42.334684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:42.334684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:42.334684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:42.334684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:42.334684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:42.334684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:42.335562 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:41:42.335562 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:41:42.335562 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:42.335562 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:42.339578 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 324/631] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:42.340448 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616c607-5916-4e31-baa7-ba75bfdee04e None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:42.353310 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e13d8c-b594-483d-80fb-74c1c9d81236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:42.354105 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e13d8c-b594-483d-80fb-74c1c9d81236 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:42.354391 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e13d8c-b594-483d-80fb-74c1c9d81236 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:42.354667 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e13d8c-b594-483d-80fb-74c1c9d81236 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:42.361945 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e13d8c-b594-483d-80fb-74c1c9d81236 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:42.363373 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e13d8c-b594-483d-80fb-74c1c9d81236 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:42.378011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-61e13d8c-b594-483d-80fb-74c1c9d81236 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:41:42.378011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:42.378011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:42.378011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:42.378011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:42.378011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:42.378011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:42.378011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:42.378011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:42.378011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:42.378011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:42.378011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:42.378011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:41:42.378011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:41:42.378011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:41:42.379064 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:41:42.379064 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:42.379064 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:42.379064 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:42.379064 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:42.379064 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:42.379064 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:42.379064 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:42.379064 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:42.379064 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:42.379064 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:42.379064 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:42.379064 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:42.379064 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:42.379064 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:42.379064 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:42.379064 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:42.380119 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:41:42.380119 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:41:42.380119 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:41:42.380119 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:41:42.380119 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:41:42.380119 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:41:42.380119 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:41:42.380119 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:42.381203 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 308/632] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:41:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:42.382158 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e13d8c-b594-483d-80fb-74c1c9d81236 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:42.440199 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616c607-5916-4e31-baa7-ba75bfdee04e None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:42.471948 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574a61d-a0f6-4fb9-b1a4-efd7a1bc936d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:42.472625 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574a61d-a0f6-4fb9-b1a4-efd7a1bc936d None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:42.472927 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574a61d-a0f6-4fb9-b1a4-efd7a1bc936d None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:42.473201 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574a61d-a0f6-4fb9-b1a4-efd7a1bc936d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:42.474008 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574a61d-a0f6-4fb9-b1a4-efd7a1bc936d None admin] RBAC: Adding query filter params (role.id=65db0aa5d0b04764ab538efe5f356652, scope.project.id=45ddbc3ac9ff421598cbe53e1252d289, user.id=43ed44bbd52047cbbcab1bc72d650b8e) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:42.474313 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574a61d-a0f6-4fb9-b1a4-efd7a1bc936d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:42.475996 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574a61d-a0f6-4fb9-b1a4-efd7a1bc936d None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:42.476426 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e13d8c-b594-483d-80fb-74c1c9d81236 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:42.481624 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 325/633] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Apr 30 20:41:42 2022] GET /identity/v3/role_assignments?user.id=43ed44bbd52047cbbcab1bc72d650b8e&scope.project.id=45ddbc3ac9ff421598cbe53e1252d289&role.id=65db0aa5d0b04764ab538efe5f356652 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:42.483702 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96d5cc-0790-42f4-ad43-6f92bc2a18a8 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:42.483702 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96d5cc-0790-42f4-ad43-6f92bc2a18a8 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:42.483702 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96d5cc-0790-42f4-ad43-6f92bc2a18a8 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:42.484777 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 326/634] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:42.485412 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96d5cc-0790-42f4-ad43-6f92bc2a18a8 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:42.518278 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13888cb5-0eaa-426b-b144-4561e41b1a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:42.518957 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13888cb5-0eaa-426b-b144-4561e41b1a3e None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:42.519236 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13888cb5-0eaa-426b-b144-4561e41b1a3e None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:42.519507 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13888cb5-0eaa-426b-b144-4561e41b1a3e None admin] PATH_INFO: `/v3/domains` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:42.520269 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13888cb5-0eaa-426b-b144-4561e41b1a3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:42.520586 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13888cb5-0eaa-426b-b144-4561e41b1a3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:42.522048 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13888cb5-0eaa-426b-b144-4561e41b1a3e None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:42.539218 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 309/635] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:42.539218 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee95dc-4f82-4a40-8c07-041a1afb6e96 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:42.539218 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee95dc-4f82-4a40-8c07-041a1afb6e96 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:42.539218 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee95dc-4f82-4a40-8c07-041a1afb6e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:42.554662 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-79ee95dc-4f82-4a40-8c07-041a1afb6e96 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:42.555869 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-79ee95dc-4f82-4a40-8c07-041a1afb6e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:42.608274 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96d5cc-0790-42f4-ad43-6f92bc2a18a8 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:42.624891 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 310/636] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:41:42.626152 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee95dc-4f82-4a40-8c07-041a1afb6e96 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:42.662610 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810ca1f-1d2b-43ab-8e35-8c999813c801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:42.663374 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810ca1f-1d2b-43ab-8e35-8c999813c801 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:42.663734 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810ca1f-1d2b-43ab-8e35-8c999813c801 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:42.664083 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810ca1f-1d2b-43ab-8e35-8c999813c801 None admin] PATH_INFO: `/v3/projects` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:42.665780 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810ca1f-1d2b-43ab-8e35-8c999813c801 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:42.666902 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810ca1f-1d2b-43ab-8e35-8c999813c801 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:42.667623 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810ca1f-1d2b-43ab-8e35-8c999813c801 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:42.682172 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 327/637] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Apr 30 20:41:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:42.682994 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810ca1f-1d2b-43ab-8e35-8c999813c801 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:42.739463 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee95dc-4f82-4a40-8c07-041a1afb6e96 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:42.775085 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83080f8b-191a-4bcf-983b-ba206b61f898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:42.775882 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83080f8b-191a-4bcf-983b-ba206b61f898 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:42.776164 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83080f8b-191a-4bcf-983b-ba206b61f898 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:42.776441 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83080f8b-191a-4bcf-983b-ba206b61f898 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:42.783858 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83080f8b-191a-4bcf-983b-ba206b61f898 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:42.785342 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83080f8b-191a-4bcf-983b-ba206b61f898 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:42.793443 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810ca1f-1d2b-43ab-8e35-8c999813c801 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:42.798893 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-83080f8b-191a-4bcf-983b-ba206b61f898 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:41:42.798893 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:42.798893 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:42.798893 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:42.798893 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:42.798893 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:42.798893 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:42.798893 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:42.798893 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:42.798893 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:42.798893 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:42.798893 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:42.798893 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:41:42.798893 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:41:42.798893 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:41:42.799766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:41:42.799766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:42.799766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:42.799766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:42.799766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:42.799766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:42.799766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:42.799766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:42.799766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:42.799766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:42.799766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:42.799766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:42.799766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:42.799766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:42.799766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:42.799766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:42.799766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:42.805600 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:41:42.805600 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:41:42.805600 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:41:42.805600 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:41:42.805600 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:41:42.805600 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:41:42.805600 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:41:42.805600 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:42.805600 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 311/638] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:41:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:42.805600 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83080f8b-191a-4bcf-983b-ba206b61f898 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:42.830588 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f828e-ba6e-4b24-8ea9-eed0a5141061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:42.831380 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f828e-ba6e-4b24-8ea9-eed0a5141061 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:42.831666 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f828e-ba6e-4b24-8ea9-eed0a5141061 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:42.831938 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f828e-ba6e-4b24-8ea9-eed0a5141061 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:42.841986 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f828e-ba6e-4b24-8ea9-eed0a5141061 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:41:42.850325 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-202f828e-ba6e-4b24-8ea9-eed0a5141061 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:41:42.850325 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:42.850325 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:42.850325 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:42.850325 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:42.850325 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:42.850325 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:42.850325 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:42.850325 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:42.850325 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:42.850325 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:42.850325 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:42.850325 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:41:42.850325 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:41:42.850325 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:41:42.850325 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:41:42.851618 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:41:42.851618 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:41:42.851618 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:41:42.851618 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:41:42.851618 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:42.851618 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:42.851618 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:42.851618 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:42.851618 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:42.851618 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:42.851618 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:42.851618 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:42.851618 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:42.851618 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:42.851618 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:42.851618 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:42.852512 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:42.852512 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:42.852512 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:42.852512 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:42.852512 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:41:42.852512 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:41:42.852512 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:41:42.852512 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:41:42.852512 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:41:42.852512 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:41:42.852512 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:41:42.852512 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:42.852512 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 328/639] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Apr 30 20:41:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:42.852512 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f828e-ba6e-4b24-8ea9-eed0a5141061 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:42.910192 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83080f8b-191a-4bcf-983b-ba206b61f898 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:42.943489 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68021a3e-b77c-4595-a870-6d8745bb3f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:42.944143 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68021a3e-b77c-4595-a870-6d8745bb3f30 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:42.944425 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68021a3e-b77c-4595-a870-6d8745bb3f30 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:42.944701 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68021a3e-b77c-4595-a870-6d8745bb3f30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:42.945560 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68021a3e-b77c-4595-a870-6d8745bb3f30 None admin] RBAC: Adding query filter params (role.id=65db0aa5d0b04764ab538efe5f356652, scope.project.id=45ddbc3ac9ff421598cbe53e1252d289, user.id=ec3374e008274f9eb4476b9f6a528fa6) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:42.945870 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68021a3e-b77c-4595-a870-6d8745bb3f30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:42.947302 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68021a3e-b77c-4595-a870-6d8745bb3f30 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:42.950900 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f828e-ba6e-4b24-8ea9-eed0a5141061 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:42.965347 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 312/640] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Apr 30 20:41:42 2022] GET /identity/v3/role_assignments?user.id=ec3374e008274f9eb4476b9f6a528fa6&scope.project.id=45ddbc3ac9ff421598cbe53e1252d289&role.id=65db0aa5d0b04764ab538efe5f356652 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:42.966519 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68021a3e-b77c-4595-a870-6d8745bb3f30 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:42.987820 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb583f7-245b-40e9-9b82-e9260c77c98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:42.988551 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb583f7-245b-40e9-9b82-e9260c77c98b None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:42.988833 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb583f7-245b-40e9-9b82-e9260c77c98b None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:42.989127 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb583f7-245b-40e9-9b82-e9260c77c98b None admin] PATH_INFO: `/v3/projects` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:42.990125 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb583f7-245b-40e9-9b82-e9260c77c98b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:42.990282 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb583f7-245b-40e9-9b82-e9260c77c98b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:42.991802 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb583f7-245b-40e9-9b82-e9260c77c98b None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:43.010559 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 329/641] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Apr 30 20:41:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:43.012355 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb583f7-245b-40e9-9b82-e9260c77c98b None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:43.089841 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68021a3e-b77c-4595-a870-6d8745bb3f30 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:43.120498 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb583f7-245b-40e9-9b82-e9260c77c98b None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:43.127799 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84a456-5ac3-490b-831d-c2e9a83d4083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:43.128541 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84a456-5ac3-490b-831d-c2e9a83d4083 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:43.128823 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84a456-5ac3-490b-831d-c2e9a83d4083 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:43.129128 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84a456-5ac3-490b-831d-c2e9a83d4083 None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:43.129876 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84a456-5ac3-490b-831d-c2e9a83d4083 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:43.130183 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84a456-5ac3-490b-831d-c2e9a83d4083 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:43.131576 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84a456-5ac3-490b-831d-c2e9a83d4083 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:43.145380 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 313/642] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:41:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:43.147261 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84a456-5ac3-490b-831d-c2e9a83d4083 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:43.159837 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612eade-7f4a-4558-ba19-39745fb65b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:43.160786 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612eade-7f4a-4558-ba19-39745fb65b16 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:43.161103 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612eade-7f4a-4558-ba19-39745fb65b16 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:43.161376 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612eade-7f4a-4558-ba19-39745fb65b16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:43.162192 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612eade-7f4a-4558-ba19-39745fb65b16 None admin] RBAC: Adding query filter params (role.id=65db0aa5d0b04764ab538efe5f356652, scope.project.id=45ddbc3ac9ff421598cbe53e1252d289, user.id=9918e808c77e4017a64c96ad24164b37) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:43.162503 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612eade-7f4a-4558-ba19-39745fb65b16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:43.163936 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612eade-7f4a-4558-ba19-39745fb65b16 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:43.170162 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 330/643] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Apr 30 20:41:43 2022] GET /identity/v3/role_assignments?user.id=9918e808c77e4017a64c96ad24164b37&scope.project.id=45ddbc3ac9ff421598cbe53e1252d289&role.id=65db0aa5d0b04764ab538efe5f356652 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:43.257045 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84a456-5ac3-490b-831d-c2e9a83d4083 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:43.294358 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf0f66-0afd-48c4-b036-4a8de742eeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:43.295169 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf0f66-0afd-48c4-b036-4a8de742eeb9 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:43.295451 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf0f66-0afd-48c4-b036-4a8de742eeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:43.295727 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf0f66-0afd-48c4-b036-4a8de742eeb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:43.308379 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf0f66-0afd-48c4-b036-4a8de742eeb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:43.309887 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf0f66-0afd-48c4-b036-4a8de742eeb9 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:43.328850 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-91bf0f66-0afd-48c4-b036-4a8de742eeb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:43.328850 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:43.328850 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:43.328850 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:43.328850 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:43.328850 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:43.328850 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:43.328850 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:43.328850 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:43.328850 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:43.328850 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:43.328850 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:43.328850 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:41:43.328850 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:41:43.328850 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:41:43.330385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:41:43.330385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:43.330385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:43.330385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:43.330385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:43.330385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:43.330385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:43.330385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:43.330385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:43.330385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:43.330385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:43.330385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:43.330385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:43.330385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:43.330385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:43.330385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:43.330385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:43.331268 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:41:43.331268 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:41:43.331268 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:43.331268 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:43.331948 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 314/644] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:41:43.338286 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612eade-7f4a-4558-ba19-39745fb65b16 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:43.444793 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612eade-7f4a-4558-ba19-39745fb65b16 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:43.479822 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca9999-3b4a-4106-bfad-ab5ab01c307f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:43.480840 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca9999-3b4a-4106-bfad-ab5ab01c307f None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:43.481374 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca9999-3b4a-4106-bfad-ab5ab01c307f None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:43.481853 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca9999-3b4a-4106-bfad-ab5ab01c307f None admin] PATH_INFO: `/v3/domains` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:43.482767 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca9999-3b4a-4106-bfad-ab5ab01c307f None admin] RBAC: Adding query filter params (name=Default) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:43.483265 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca9999-3b4a-4106-bfad-ab5ab01c307f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:43.484832 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca9999-3b4a-4106-bfad-ab5ab01c307f None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:43.497452 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 331/645] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:43.503310 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf0f66-0afd-48c4-b036-4a8de742eeb9 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:43.605259 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf0f66-0afd-48c4-b036-4a8de742eeb9 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:43.639709 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8663c0-f390-4dda-8398-d6e9d7379658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:43.640881 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8663c0-f390-4dda-8398-d6e9d7379658 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:43.641446 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8663c0-f390-4dda-8398-d6e9d7379658 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:43.642018 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8663c0-f390-4dda-8398-d6e9d7379658 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:43.649898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8663c0-f390-4dda-8398-d6e9d7379658 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:43.651614 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8663c0-f390-4dda-8398-d6e9d7379658 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:43.666898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-0a8663c0-f390-4dda-8398-d6e9d7379658 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 30 20:41:43.666898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:43.666898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:43.666898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:43.666898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:43.666898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:43.666898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:43.666898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:43.666898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:43.666898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:43.666898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:43.666898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:43.666898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:41:43.666898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:41:43.666898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:41:43.666898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:41:43.667898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:43.667898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:43.667898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:41:43.667898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:41:43.667898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:41:43.667898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:41:43.667898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:43.667898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:43.667898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:43.667898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:43.667898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:43.667898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:43.667898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:43.667898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:43.667898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:43.667898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:43.667898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:43.667898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:43.668820 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:43.668820 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:43.668820 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:41:43.668820 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:41:43.668820 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:41:43.668820 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:41:43.668820 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:41:43.668820 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:41:43.668820 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Apr 30 20:41:43.668820 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:43.671391 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 315/646] 10.222.0.26 () {56 vars in 1093 bytes} [Sat Apr 30 20:41:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:43.677701 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca9999-3b4a-4106-bfad-ab5ab01c307f None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:43.780433 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca9999-3b4a-4106-bfad-ab5ab01c307f None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:43.822505 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0675b7-4bbc-43a1-b9d2-6e2c248c3048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:43.823186 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0675b7-4bbc-43a1-b9d2-6e2c248c3048 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:43.823466 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0675b7-4bbc-43a1-b9d2-6e2c248c3048 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:43.823736 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0675b7-4bbc-43a1-b9d2-6e2c248c3048 None admin] PATH_INFO: `/v3/users` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:43.824560 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0675b7-4bbc-43a1-b9d2-6e2c248c3048 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:43.824868 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0675b7-4bbc-43a1-b9d2-6e2c248c3048 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:43.826332 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0675b7-4bbc-43a1-b9d2-6e2c248c3048 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:43.844416 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 332/647] 10.222.0.26 () {56 vars in 1133 bytes} [Sat Apr 30 20:41:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:43.850275 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8663c0-f390-4dda-8398-d6e9d7379658 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:43.952249 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8663c0-f390-4dda-8398-d6e9d7379658 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:43.987232 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac3642-e0b6-4357-a4b8-1e0b85f2e104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:43.987881 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac3642-e0b6-4357-a4b8-1e0b85f2e104 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:43.988166 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac3642-e0b6-4357-a4b8-1e0b85f2e104 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:43.988439 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac3642-e0b6-4357-a4b8-1e0b85f2e104 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:44.056110 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac3642-e0b6-4357-a4b8-1e0b85f2e104 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:44.057652 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac3642-e0b6-4357-a4b8-1e0b85f2e104 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:44.161982 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 316/648] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:41:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:41:44.163324 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0675b7-4bbc-43a1-b9d2-6e2c248c3048 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:44.264668 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0675b7-4bbc-43a1-b9d2-6e2c248c3048 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:44.302133 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c6dc7-eb43-48a0-b2f6-253966e34c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:44.302923 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c6dc7-eb43-48a0-b2f6-253966e34c7a None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:44.303197 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c6dc7-eb43-48a0-b2f6-253966e34c7a None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:44.303463 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c6dc7-eb43-48a0-b2f6-253966e34c7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:44.314598 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c6dc7-eb43-48a0-b2f6-253966e34c7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:44.316057 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c6dc7-eb43-48a0-b2f6-253966e34c7a None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:44.333712 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-a44c6dc7-eb43-48a0-b2f6-253966e34c7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:44.333712 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:44.333712 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:44.333712 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:44.333712 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:44.333712 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:44.333712 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:44.333712 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:44.333712 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:44.333712 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:44.333712 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:44.333712 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:44.333712 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:41:44.333712 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:41:44.333712 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:41:44.335732 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:41:44.335732 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:44.335732 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:44.335732 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:44.335732 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:44.335732 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:44.335732 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:44.335732 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:44.335732 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:44.335732 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:44.335732 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:44.335732 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:44.335732 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:44.335732 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:44.335732 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:44.335732 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:44.335732 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:44.337919 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:41:44.337919 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:41:44.337919 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:44.337919 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:44.340955 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 333/649] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:44.342203 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac3642-e0b6-4357-a4b8-1e0b85f2e104 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:44.448880 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac3642-e0b6-4357-a4b8-1e0b85f2e104 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:44.485449 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6d58d-0d8e-47c1-9dc2-0d7b342c6d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:44.486350 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6d58d-0d8e-47c1-9dc2-0d7b342c6d2a None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:44.486636 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6d58d-0d8e-47c1-9dc2-0d7b342c6d2a None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:44.486911 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6d58d-0d8e-47c1-9dc2-0d7b342c6d2a None admin] PATH_INFO: `/v3/domains` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:44.487630 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6d58d-0d8e-47c1-9dc2-0d7b342c6d2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:44.487936 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6d58d-0d8e-47c1-9dc2-0d7b342c6d2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:44.489343 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6d58d-0d8e-47c1-9dc2-0d7b342c6d2a None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:44.501674 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 317/650] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:41:44.507140 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c6dc7-eb43-48a0-b2f6-253966e34c7a None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:44.608829 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c6dc7-eb43-48a0-b2f6-253966e34c7a None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:44.646014 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044588c-3f56-49e8-a445-177ff0f9bf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:44.646808 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044588c-3f56-49e8-a445-177ff0f9bf89 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:44.647084 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044588c-3f56-49e8-a445-177ff0f9bf89 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:44.647355 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044588c-3f56-49e8-a445-177ff0f9bf89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:44.654104 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044588c-3f56-49e8-a445-177ff0f9bf89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:44.655631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044588c-3f56-49e8-a445-177ff0f9bf89 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:44.669203 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-1044588c-3f56-49e8-a445-177ff0f9bf89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:41:44.669203 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:44.669203 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:44.669203 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:44.669203 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:44.669203 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:44.669203 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:44.669203 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:44.669203 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:44.669203 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:44.669203 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:44.669203 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:44.669203 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:41:44.669203 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:41:44.669203 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:41:44.670169 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:41:44.670169 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:44.670169 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:44.670169 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:44.670169 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:44.670169 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:44.670169 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:44.670169 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:44.670169 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:44.670169 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:44.670169 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:44.670169 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:44.670169 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:44.670169 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:44.670169 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:44.670169 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:44.670169 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:44.671234 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:41:44.671234 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:41:44.671234 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:41:44.671234 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:41:44.671234 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:41:44.671234 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:41:44.671234 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:41:44.671234 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:44.671234 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 334/651] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:41:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:44.678295 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6d58d-0d8e-47c1-9dc2-0d7b342c6d2a None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:44.786192 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6d58d-0d8e-47c1-9dc2-0d7b342c6d2a None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:44.824236 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14feb434-342e-48ff-9170-c99b708b1343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:44.824236 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14feb434-342e-48ff-9170-c99b708b1343 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:44.824236 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14feb434-342e-48ff-9170-c99b708b1343 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:44.824236 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14feb434-342e-48ff-9170-c99b708b1343 None admin] PATH_INFO: `/v3/projects` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:44.824547 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14feb434-342e-48ff-9170-c99b708b1343 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:44.824547 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14feb434-342e-48ff-9170-c99b708b1343 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:44.824547 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14feb434-342e-48ff-9170-c99b708b1343 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:44.838013 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 318/652] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Apr 30 20:41:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:44.843995 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044588c-3f56-49e8-a445-177ff0f9bf89 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:44.903562 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84944ae6-448d-4894-9d6a-47a9c30a87d5 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:44.903780 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84944ae6-448d-4894-9d6a-47a9c30a87d5 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:44.904028 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84944ae6-448d-4894-9d6a-47a9c30a87d5 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:44.905692 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 319/653] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:44.915239 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a79c7-93ba-4aef-bf8a-a2d7d7a03a41 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:44.915800 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a79c7-93ba-4aef-bf8a-a2d7d7a03a41 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:44.916276 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a79c7-93ba-4aef-bf8a-a2d7d7a03a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:44.933430 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-5a3a79c7-93ba-4aef-bf8a-a2d7d7a03a41 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:44.934953 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-5a3a79c7-93ba-4aef-bf8a-a2d7d7a03a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:44.952682 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044588c-3f56-49e8-a445-177ff0f9bf89 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:44.989264 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c5632-e9d0-4846-a95f-8cd560dc41b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:44.990345 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c5632-e9d0-4846-a95f-8cd560dc41b6 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:44.990829 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c5632-e9d0-4846-a95f-8cd560dc41b6 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:44.991351 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c5632-e9d0-4846-a95f-8cd560dc41b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:44.992370 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c5632-e9d0-4846-a95f-8cd560dc41b6 None admin] RBAC: Adding query filter params (role.id=31b3f11a82cd4cd2823e88aa0e931323, scope.project.id=45ddbc3ac9ff421598cbe53e1252d289, user.id=2aee3a7a6b4b4d489993c131f3ae2048) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:44.992936 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c5632-e9d0-4846-a95f-8cd560dc41b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:44.994585 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c5632-e9d0-4846-a95f-8cd560dc41b6 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:45.002321 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 335/654] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Apr 30 20:41:44 2022] GET /identity/v3/role_assignments?user.id=2aee3a7a6b4b4d489993c131f3ae2048&scope.project.id=45ddbc3ac9ff421598cbe53e1252d289&role.id=31b3f11a82cd4cd2823e88aa0e931323 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:45.010497 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 320/655] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Apr 30 20:41:45.034261 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c5632-e9d0-4846-a95f-8cd560dc41b6 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:45.144687 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c5632-e9d0-4846-a95f-8cd560dc41b6 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:45.182146 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e1f5c-dbf0-4c08-8588-0938bec26451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:45.182870 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e1f5c-dbf0-4c08-8588-0938bec26451 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:45.183161 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e1f5c-dbf0-4c08-8588-0938bec26451 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:45.183427 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e1f5c-dbf0-4c08-8588-0938bec26451 None admin] PATH_INFO: `/v3/services/image` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:45.184080 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e1f5c-dbf0-4c08-8588-0938bec26451 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:45.185892 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e1f5c-dbf0-4c08-8588-0938bec26451 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:45.200058 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-fb7e1f5c-dbf0-4c08-8588-0938bec26451 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 30 20:41:45.200058 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:45.200058 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:41:45.200058 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:41:45.200058 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:41:45.200058 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:41:45.200058 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:41:45.200058 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:41:45.200058 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Apr 30 20:41:45.200058 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:45.200058 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:41:45.200058 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:45.200058 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:45.200058 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:45.200058 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:45.200058 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:45.200058 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:45.201112 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:45.201112 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:45.201112 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:45.201112 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:45.201112 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:45.201112 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:45.201112 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:41:45.201112 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:41:45.201112 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:41:45.201112 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:41:45.201112 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:45.201112 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:45.201112 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:45.201112 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:45.201112 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:45.201112 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:45.201983 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:45.201983 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:45.201983 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:45.201983 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:45.201983 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:45.201983 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:45.201983 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:45.201983 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:45.201983 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:45.201983 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:45.201983 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:41:45.201983 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:41:45.201983 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Apr 30 20:41:45.201983 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:45.201983 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 336/656] 10.222.0.26 () {56 vars in 1105 bytes} [Sat Apr 30 20:41:45 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:45.207824 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a79c7-93ba-4aef-bf8a-a2d7d7a03a41 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:45.313311 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a79c7-93ba-4aef-bf8a-a2d7d7a03a41 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:45.349984 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f4924-56a6-4555-a83c-55db4f69f1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:45.351054 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f4924-56a6-4555-a83c-55db4f69f1ad None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:45.351216 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f4924-56a6-4555-a83c-55db4f69f1ad None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:45.351430 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f4924-56a6-4555-a83c-55db4f69f1ad None admin] PATH_INFO: `/v3/services` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:45.352126 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f4924-56a6-4555-a83c-55db4f69f1ad None admin] RBAC: Adding query filter params (name=image) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:45.352434 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f4924-56a6-4555-a83c-55db4f69f1ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:45.353830 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f4924-56a6-4555-a83c-55db4f69f1ad None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:45.358756 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 321/657] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:45.364862 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e1f5c-dbf0-4c08-8588-0938bec26451 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:45.472482 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e1f5c-dbf0-4c08-8588-0938bec26451 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:45.501420 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c74a61-c306-44b3-bc7c-8cd716180e42 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:45.501746 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c74a61-c306-44b3-bc7c-8cd716180e42 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:45.502082 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c74a61-c306-44b3-bc7c-8cd716180e42 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:45.503633 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 322/658] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:41:45.508003 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53efe99-bdc7-4955-b076-166a710116d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:45.508535 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0e3bc-adaf-45c9-8844-e72ff1cb8ce9 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:45.508822 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0e3bc-adaf-45c9-8844-e72ff1cb8ce9 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:45.509134 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0e3bc-adaf-45c9-8844-e72ff1cb8ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:45.509574 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53efe99-bdc7-4955-b076-166a710116d6 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:45.510093 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53efe99-bdc7-4955-b076-166a710116d6 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:45.510689 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53efe99-bdc7-4955-b076-166a710116d6 None admin] PATH_INFO: `/v3/services` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:45.511782 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53efe99-bdc7-4955-b076-166a710116d6 None admin] RBAC: Adding query filter params (type=image) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:45.512288 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53efe99-bdc7-4955-b076-166a710116d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:45.514070 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53efe99-bdc7-4955-b076-166a710116d6 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:45.521030 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 337/659] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:45 2022] GET /identity/v3/services?type=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:45.534543 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-37b0e3bc-adaf-45c9-8844-e72ff1cb8ce9 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:45.536220 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-37b0e3bc-adaf-45c9-8844-e72ff1cb8ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:45.607581 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 323/660] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:41:45.620798 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37879080-807e-46e2-a57a-5c0cdd663847 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:45.621127 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37879080-807e-46e2-a57a-5c0cdd663847 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:45.621410 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37879080-807e-46e2-a57a-5c0cdd663847 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:45.623090 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 338/661] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:45.629179 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25805a-1a96-414c-b5aa-532891a7c97b None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:45.629775 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25805a-1a96-414c-b5aa-532891a7c97b None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:45.630306 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25805a-1a96-414c-b5aa-532891a7c97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:45.631509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37879080-807e-46e2-a57a-5c0cdd663847 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:45.651738 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-7c25805a-1a96-414c-b5aa-532891a7c97b None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:45.653761 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-7c25805a-1a96-414c-b5aa-532891a7c97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:45.746798 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 324/662] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:41:45.759627 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37879080-807e-46e2-a57a-5c0cdd663847 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:45.770342 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25805a-1a96-414c-b5aa-532891a7c97b None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:45.797409 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a3312-62b8-4893-a2c1-6bf379adaeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:45.799527 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a3312-62b8-4893-a2c1-6bf379adaeff None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:45.800094 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a3312-62b8-4893-a2c1-6bf379adaeff None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:45.800571 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a3312-62b8-4893-a2c1-6bf379adaeff None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:45.801479 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a3312-62b8-4893-a2c1-6bf379adaeff None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:45.803150 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a3312-62b8-4893-a2c1-6bf379adaeff None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:45.816355 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-9d4a3312-62b8-4893-a2c1-6bf379adaeff None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 30 20:41:45.816355 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:45.816355 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:41:45.816355 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:41:45.816355 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:41:45.816355 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:41:45.816355 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:41:45.816355 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:41:45.816355 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 30 20:41:45.816355 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:45.816355 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:41:45.816355 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:45.816355 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:45.816355 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:45.816355 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:45.816355 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:45.817371 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:45.817371 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:45.817371 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:45.817371 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:45.817371 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:45.817371 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:45.817371 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:45.817371 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:41:45.817371 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:41:45.817371 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:41:45.817371 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:41:45.817371 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:45.817371 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:45.817371 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:45.817371 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:45.817371 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:45.818225 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:45.818225 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:45.818225 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:45.818225 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:45.818225 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:45.818225 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:45.818225 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:45.818225 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:45.818225 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:45.818225 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:45.818225 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:45.818225 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:41:45.818225 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:41:45.818225 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 30 20:41:45.818225 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:45.821324 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 339/663] 10.222.0.26 () {56 vars in 1129 bytes} [Sat Apr 30 20:41:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:45.831372 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a3312-62b8-4893-a2c1-6bf379adaeff None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:45.872058 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25805a-1a96-414c-b5aa-532891a7c97b None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:45.907951 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f32af1-c503-484d-932d-b912e2d17041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:45.909191 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f32af1-c503-484d-932d-b912e2d17041 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:45.909480 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f32af1-c503-484d-932d-b912e2d17041 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:45.909758 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f32af1-c503-484d-932d-b912e2d17041 None admin] PATH_INFO: `/v3/services/network` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:45.910421 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f32af1-c503-484d-932d-b912e2d17041 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:45.911821 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f32af1-c503-484d-932d-b912e2d17041 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:45.926945 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-61f32af1-c503-484d-932d-b912e2d17041 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 30 20:41:45.926945 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:45.926945 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:41:45.926945 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:41:45.926945 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:41:45.926945 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:41:45.926945 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:41:45.926945 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:41:45.926945 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Apr 30 20:41:45.926945 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:45.926945 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:41:45.926945 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:45.926945 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:45.926945 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:45.926945 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:45.926945 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:45.926945 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:45.928208 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:45.928208 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:45.928208 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:45.928208 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:45.928208 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:45.928208 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:45.928208 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:41:45.928208 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:41:45.928208 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:41:45.928208 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:41:45.928208 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:45.928208 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:45.928208 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:45.928208 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:45.928208 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:45.928208 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:45.929116 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:45.929116 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:45.929116 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:45.929116 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:45.929116 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:45.929116 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:45.929116 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:45.929116 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:45.929116 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:45.929116 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:45.929116 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:41:45.929116 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:41:45.929116 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Apr 30 20:41:45.929116 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:45.929116 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 325/664] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:41:45 2022] GET /identity/v3/services/network => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:41:45.938800 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f32af1-c503-484d-932d-b912e2d17041 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:45.944265 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a3312-62b8-4893-a2c1-6bf379adaeff None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:45.987832 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11053139-86da-4625-a80c-8ff7df94ae42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:45.988623 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11053139-86da-4625-a80c-8ff7df94ae42 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:45.988784 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11053139-86da-4625-a80c-8ff7df94ae42 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:45.989238 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11053139-86da-4625-a80c-8ff7df94ae42 None admin] PATH_INFO: `/v3/services` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:45.990320 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11053139-86da-4625-a80c-8ff7df94ae42 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:45.990640 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11053139-86da-4625-a80c-8ff7df94ae42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:45.992504 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11053139-86da-4625-a80c-8ff7df94ae42 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:46.002895 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 340/665] 10.222.0.26 () {56 vars in 1124 bytes} [Sat Apr 30 20:41:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:46.003674 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11053139-86da-4625-a80c-8ff7df94ae42 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:46.055215 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f32af1-c503-484d-932d-b912e2d17041 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:46.093102 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2a2f6-ebc9-4b48-8cc5-286d73d236dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:46.093762 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2a2f6-ebc9-4b48-8cc5-286d73d236dc None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:46.094041 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2a2f6-ebc9-4b48-8cc5-286d73d236dc None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:46.094312 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2a2f6-ebc9-4b48-8cc5-286d73d236dc None admin] PATH_INFO: `/v3/services` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:46.095633 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2a2f6-ebc9-4b48-8cc5-286d73d236dc None admin] RBAC: Adding query filter params (name=network) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:46.095940 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2a2f6-ebc9-4b48-8cc5-286d73d236dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:46.097414 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2a2f6-ebc9-4b48-8cc5-286d73d236dc None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:46.107175 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 326/666] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Apr 30 20:41:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:41:46.108074 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2a2f6-ebc9-4b48-8cc5-286d73d236dc None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:46.120768 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11053139-86da-4625-a80c-8ff7df94ae42 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:46.155786 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a4e79-683b-45e5-a413-191b494342e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:46.156464 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a4e79-683b-45e5-a413-191b494342e5 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:46.156749 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a4e79-683b-45e5-a413-191b494342e5 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:46.157053 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a4e79-683b-45e5-a413-191b494342e5 None admin] PATH_INFO: `/v3/services` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:46.158622 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a4e79-683b-45e5-a413-191b494342e5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:46.159120 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a4e79-683b-45e5-a413-191b494342e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:46.160508 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a4e79-683b-45e5-a413-191b494342e5 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:46.173053 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 341/667] 10.222.0.26 () {56 vars in 1124 bytes} [Sat Apr 30 20:41:46 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:46.215395 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2a2f6-ebc9-4b48-8cc5-286d73d236dc None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:46.253740 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22473d52-5dd5-4c75-964f-0a2c6cf5f914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:46.254333 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22473d52-5dd5-4c75-964f-0a2c6cf5f914 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:46.254611 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22473d52-5dd5-4c75-964f-0a2c6cf5f914 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:46.254884 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22473d52-5dd5-4c75-964f-0a2c6cf5f914 None admin] PATH_INFO: `/v3/services` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:46.255589 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22473d52-5dd5-4c75-964f-0a2c6cf5f914 None admin] RBAC: Adding query filter params (type=network) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:46.255892 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22473d52-5dd5-4c75-964f-0a2c6cf5f914 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:46.257305 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22473d52-5dd5-4c75-964f-0a2c6cf5f914 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:46.263985 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 327/668] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Apr 30 20:41:46 2022] GET /identity/v3/services?type=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:47.334137 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844dbc4e-9d53-452f-90ae-12a03efcae9f None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:47.334881 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844dbc4e-9d53-452f-90ae-12a03efcae9f None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:47.334881 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844dbc4e-9d53-452f-90ae-12a03efcae9f None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:47.336410 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 342/669] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:47.341784 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25b8da-8cb4-465d-81df-463d5e760b87 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:47.342283 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25b8da-8cb4-465d-81df-463d5e760b87 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:47.342437 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25b8da-8cb4-465d-81df-463d5e760b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:47.360283 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-ac25b8da-8cb4-465d-81df-463d5e760b87 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:47.362299 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-ac25b8da-8cb4-465d-81df-463d5e760b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:47.441027 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 328/670] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:41:47.458707 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844dbc4e-9d53-452f-90ae-12a03efcae9f None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:47.566023 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844dbc4e-9d53-452f-90ae-12a03efcae9f None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:47.601158 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d84776-45b1-40ad-bbc6-6ad70a0c8fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:47.601878 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d84776-45b1-40ad-bbc6-6ad70a0c8fac None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:47.602154 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d84776-45b1-40ad-bbc6-6ad70a0c8fac None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:47.602426 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d84776-45b1-40ad-bbc6-6ad70a0c8fac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:47.612499 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d84776-45b1-40ad-bbc6-6ad70a0c8fac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:41:47.620132 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-e4d84776-45b1-40ad-bbc6-6ad70a0c8fac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:41:47.620132 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:47.620132 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:47.620132 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:47.620132 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:47.620132 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:47.620132 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:47.620132 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:47.620132 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:47.620132 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:47.620132 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:47.620132 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:47.620132 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:41:47.620132 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:41:47.620132 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:41:47.620132 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:41:47.622418 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:41:47.622418 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:41:47.622418 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:41:47.622418 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:41:47.622418 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:47.622418 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:47.622418 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:47.622418 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:47.622418 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:47.622418 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:47.622418 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:47.622418 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:47.622418 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:47.622418 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:47.622418 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:47.622418 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:47.624495 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:47.624495 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:47.624495 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:47.624495 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:47.624495 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:41:47.624495 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:41:47.624495 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:41:47.624495 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:41:47.624495 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:41:47.624495 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:41:47.624495 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:41:47.624495 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:47.626166 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 343/671] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Apr 30 20:41:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:47.628763 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25b8da-8cb4-465d-81df-463d5e760b87 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:47.727677 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25b8da-8cb4-465d-81df-463d5e760b87 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:47.768629 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437dbd5-08a3-403b-94c4-76cdffa61557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:47.769797 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437dbd5-08a3-403b-94c4-76cdffa61557 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:47.770299 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437dbd5-08a3-403b-94c4-76cdffa61557 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:47.770787 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437dbd5-08a3-403b-94c4-76cdffa61557 None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:47.771735 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2437dbd5-08a3-403b-94c4-76cdffa61557 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:47.772266 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2437dbd5-08a3-403b-94c4-76cdffa61557 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:47.773894 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2437dbd5-08a3-403b-94c4-76cdffa61557 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:47.783600 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 329/672] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:41:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:47.793429 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d84776-45b1-40ad-bbc6-6ad70a0c8fac None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:47.907936 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d84776-45b1-40ad-bbc6-6ad70a0c8fac None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:47.927782 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b450a8-8c58-460d-b82f-e6e1ab3a78b7 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:47.928078 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b450a8-8c58-460d-b82f-e6e1ab3a78b7 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:47.928356 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b450a8-8c58-460d-b82f-e6e1ab3a78b7 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:47.929946 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 330/673] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:47.934947 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be254185-9161-4e5f-8f6d-64017167e219 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:47.935305 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be254185-9161-4e5f-8f6d-64017167e219 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:47.935581 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be254185-9161-4e5f-8f6d-64017167e219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:47.944220 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae98843-960e-4e11-a6c0-0a65a35f915e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:47.945314 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae98843-960e-4e11-a6c0-0a65a35f915e None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:47.945764 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae98843-960e-4e11-a6c0-0a65a35f915e None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:47.946191 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae98843-960e-4e11-a6c0-0a65a35f915e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:47.952511 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-be254185-9161-4e5f-8f6d-64017167e219 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:47.953709 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-be254185-9161-4e5f-8f6d-64017167e219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:47.957555 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae98843-960e-4e11-a6c0-0a65a35f915e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:47.959002 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae98843-960e-4e11-a6c0-0a65a35f915e None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:47.982047 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-2ae98843-960e-4e11-a6c0-0a65a35f915e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:47.982047 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:47.982047 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:47.982047 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:47.982047 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:47.982047 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:47.982047 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:47.982047 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:47.982047 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:47.982047 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:47.982047 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:47.982047 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:47.982047 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:41:47.982047 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:41:47.982047 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:41:47.983006 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:41:47.983006 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:47.983006 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:47.983006 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:47.983006 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:47.983006 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:47.983006 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:47.983006 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:47.983006 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:47.983006 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:47.983006 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:47.983006 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:47.983006 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:47.983006 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:47.983006 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:47.983006 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:47.983006 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:47.983892 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:41:47.983892 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:41:47.983892 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:47.983892 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:47.987250 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 344/674] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:47.992532 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae98843-960e-4e11-a6c0-0a65a35f915e None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:48.032144 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 331/675] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:41:48.055862 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be254185-9161-4e5f-8f6d-64017167e219 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:48.100128 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae98843-960e-4e11-a6c0-0a65a35f915e None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:48.139754 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6fea54-34af-4ea7-9417-28bf4d4a1c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:48.140434 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fea54-34af-4ea7-9417-28bf4d4a1c8b None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:48.140715 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fea54-34af-4ea7-9417-28bf4d4a1c8b None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:48.141023 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fea54-34af-4ea7-9417-28bf4d4a1c8b None admin] PATH_INFO: `/v3/domains` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:48.142571 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6fea54-34af-4ea7-9417-28bf4d4a1c8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:48.142990 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6fea54-34af-4ea7-9417-28bf4d4a1c8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:48.144651 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6fea54-34af-4ea7-9417-28bf4d4a1c8b None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:48.161422 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 345/676] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:41:48.169505 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6fea54-34af-4ea7-9417-28bf4d4a1c8b None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:48.177296 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be254185-9161-4e5f-8f6d-64017167e219 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:48.211002 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146eb90b-93ce-4074-816b-b4c887207d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:48.211653 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146eb90b-93ce-4074-816b-b4c887207d7a None admin] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:48.211933 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146eb90b-93ce-4074-816b-b4c887207d7a None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:48.212205 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146eb90b-93ce-4074-816b-b4c887207d7a None admin] PATH_INFO: `/v3/services` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:48.212953 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146eb90b-93ce-4074-816b-b4c887207d7a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:48.214329 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146eb90b-93ce-4074-816b-b4c887207d7a None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:48.271399 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6fea54-34af-4ea7-9417-28bf4d4a1c8b None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:48.305124 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9cc4f5-57ea-44eb-aa8a-5551953d8ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:48.305914 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cc4f5-57ea-44eb-aa8a-5551953d8ad6 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:48.306193 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cc4f5-57ea-44eb-aa8a-5551953d8ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:48.306464 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cc4f5-57ea-44eb-aa8a-5551953d8ad6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:48.315459 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9cc4f5-57ea-44eb-aa8a-5551953d8ad6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:48.316942 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9cc4f5-57ea-44eb-aa8a-5551953d8ad6 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:48.321257 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 332/677] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Apr 30 20:41:48 2022] POST /identity/v3/services => generated 242 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 20:41:48.340116 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-bf9cc4f5-57ea-44eb-aa8a-5551953d8ad6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 30 20:41:48.340116 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:48.340116 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:48.340116 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:48.340116 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:48.340116 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:48.340116 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:48.340116 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:48.340116 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:48.340116 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:48.340116 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:48.340116 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:48.340116 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:41:48.340116 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:41:48.340116 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:41:48.340116 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:41:48.341543 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:48.341543 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:48.341543 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:41:48.341543 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:41:48.341543 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:41:48.341543 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:41:48.341543 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:48.341543 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:48.341543 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:48.341543 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:48.341543 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:48.341543 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:48.341543 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:48.341543 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:48.341543 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:48.341543 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:48.341543 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:48.341543 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:48.342521 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:48.342521 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:48.342521 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:41:48.342521 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:41:48.342521 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:41:48.342521 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:41:48.342521 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:41:48.342521 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:41:48.342521 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Apr 30 20:41:48.342521 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:48.351052 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 346/678] 10.222.0.26 () {56 vars in 1093 bytes} [Sat Apr 30 20:41:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:41:48.352976 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146eb90b-93ce-4074-816b-b4c887207d7a None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:48.489027 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146eb90b-93ce-4074-816b-b4c887207d7a None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:48.530523 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20d6e5-b282-4743-8b88-52d255d63a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:48.531209 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20d6e5-b282-4743-8b88-52d255d63a13 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:48.532926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20d6e5-b282-4743-8b88-52d255d63a13 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:48.532926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20d6e5-b282-4743-8b88-52d255d63a13 None admin] PATH_INFO: `/v3/users` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:48.532926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20d6e5-b282-4743-8b88-52d255d63a13 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:48.533374 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20d6e5-b282-4743-8b88-52d255d63a13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:48.534429 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20d6e5-b282-4743-8b88-52d255d63a13 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:48.553586 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 333/679] 10.222.0.26 () {56 vars in 1133 bytes} [Sat Apr 30 20:41:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:48.559577 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9cc4f5-57ea-44eb-aa8a-5551953d8ad6 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:48.619590 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3792d2-a60f-47f6-8384-e87462168241 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:48.620201 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3792d2-a60f-47f6-8384-e87462168241 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:48.620586 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3792d2-a60f-47f6-8384-e87462168241 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:48.622422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 334/680] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:48.630137 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d916e-08f7-456b-9539-a55a4be590b8 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:48.630726 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d916e-08f7-456b-9539-a55a4be590b8 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:48.631222 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d916e-08f7-456b-9539-a55a4be590b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:48.648600 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-370d916e-08f7-456b-9539-a55a4be590b8 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:48.650196 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-370d916e-08f7-456b-9539-a55a4be590b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:48.685502 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9cc4f5-57ea-44eb-aa8a-5551953d8ad6 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:48.721631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c46ba-5101-43ff-967d-cb5164c2103d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:48.722428 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c46ba-5101-43ff-967d-cb5164c2103d None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:48.722706 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c46ba-5101-43ff-967d-cb5164c2103d None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:48.722978 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c46ba-5101-43ff-967d-cb5164c2103d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:48.733055 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 335/681] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:48 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:41:48.734497 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fc4c8-4c04-49e1-955f-720b10c5ec7d None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:48.734790 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fc4c8-4c04-49e1-955f-720b10c5ec7d None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:48.735070 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fc4c8-4c04-49e1-955f-720b10c5ec7d None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:48.737336 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 336/682] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:48.739246 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c46ba-5101-43ff-967d-cb5164c2103d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:48.740680 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c46ba-5101-43ff-967d-cb5164c2103d None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:48.746301 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8a86d-1661-4651-972f-dd2cf09f260f None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:48.746592 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8a86d-1661-4651-972f-dd2cf09f260f None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:48.746972 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8a86d-1661-4651-972f-dd2cf09f260f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:48.761502 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-a15c46ba-5101-43ff-967d-cb5164c2103d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:48.761502 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:48.761502 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:48.761502 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:48.761502 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:48.761502 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:48.761502 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:48.761502 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:48.761502 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:48.761502 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:48.761502 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:48.761502 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:48.761502 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:41:48.761502 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:41:48.761502 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:41:48.762520 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:41:48.762520 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:48.762520 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:48.762520 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:48.762520 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:48.762520 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:48.762520 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:48.762520 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:48.762520 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:48.762520 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:48.762520 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:48.762520 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:48.762520 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:48.762520 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:48.762520 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:48.762520 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:48.762520 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:48.763795 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:41:48.763795 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:41:48.763795 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:48.763795 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:48.763795 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 347/683] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:48.764089 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c46ba-5101-43ff-967d-cb5164c2103d None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:48.764351 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-f2e8a86d-1661-4651-972f-dd2cf09f260f None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:48.765602 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-f2e8a86d-1661-4651-972f-dd2cf09f260f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:48.842722 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 337/684] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:48 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:41:48.844520 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8a86d-1661-4651-972f-dd2cf09f260f None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:48.873636 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c46ba-5101-43ff-967d-cb5164c2103d None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:48.908055 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa3ffc-b894-4b3e-aa01-c7f53d7359f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:48.908723 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa3ffc-b894-4b3e-aa01-c7f53d7359f1 None admin] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:48.909043 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa3ffc-b894-4b3e-aa01-c7f53d7359f1 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:48.909326 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa3ffc-b894-4b3e-aa01-c7f53d7359f1 None admin] PATH_INFO: `/v3/services` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:48.910046 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa3ffc-b894-4b3e-aa01-c7f53d7359f1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:48.911435 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa3ffc-b894-4b3e-aa01-c7f53d7359f1 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:48.952617 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8a86d-1661-4651-972f-dd2cf09f260f None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:48.976945 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 348/685] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Apr 30 20:41:48 2022] POST /identity/v3/services => generated 251 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:41:48.978014 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa3ffc-b894-4b3e-aa01-c7f53d7359f1 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:49.003450 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ae29b-cd9a-4e99-8bc0-d3cfac12b719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:49.004690 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ae29b-cd9a-4e99-8bc0-d3cfac12b719 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:49.005170 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ae29b-cd9a-4e99-8bc0-d3cfac12b719 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:49.005607 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ae29b-cd9a-4e99-8bc0-d3cfac12b719 None admin] PATH_INFO: `/v3/domains` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:49.007085 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ae29b-cd9a-4e99-8bc0-d3cfac12b719 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:49.007589 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ae29b-cd9a-4e99-8bc0-d3cfac12b719 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:49.009665 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ae29b-cd9a-4e99-8bc0-d3cfac12b719 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:49.031296 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 338/686] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:49.036202 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ae29b-cd9a-4e99-8bc0-d3cfac12b719 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:49.111074 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa3ffc-b894-4b3e-aa01-c7f53d7359f1 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:49.148542 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58642b-bb2e-4dec-9bb9-f9a1192600b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:49.149279 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58642b-bb2e-4dec-9bb9-f9a1192600b9 None admin] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:49.149578 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58642b-bb2e-4dec-9bb9-f9a1192600b9 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:49.149844 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58642b-bb2e-4dec-9bb9-f9a1192600b9 None admin] PATH_INFO: `/v3/services` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:49.150576 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58642b-bb2e-4dec-9bb9-f9a1192600b9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:49.152224 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58642b-bb2e-4dec-9bb9-f9a1192600b9 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:49.159147 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ae29b-cd9a-4e99-8bc0-d3cfac12b719 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:49.196591 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733c70b-40bd-494f-882e-a175ab76a9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:49.197528 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733c70b-40bd-494f-882e-a175ab76a9d6 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:49.203113 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733c70b-40bd-494f-882e-a175ab76a9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:49.203113 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733c70b-40bd-494f-882e-a175ab76a9d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:49.205557 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733c70b-40bd-494f-882e-a175ab76a9d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:49.207593 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733c70b-40bd-494f-882e-a175ab76a9d6 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:49.224490 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-5733c70b-40bd-494f-882e-a175ab76a9d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:41:49.224490 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:49.224490 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:49.224490 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:49.224490 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:49.224490 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:49.224490 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:49.224490 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:49.224490 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:49.224490 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:49.224490 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:49.224490 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:49.224490 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:41:49.224490 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:41:49.224490 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:41:49.226015 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:41:49.226015 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:49.226015 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:49.226015 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:49.226015 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:49.226015 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:49.226015 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:49.226015 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:49.226015 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:49.226015 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:49.226015 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:49.226015 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:49.226015 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:49.226015 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:49.226015 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:49.226015 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:49.226015 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:49.227087 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:41:49.227087 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:41:49.227087 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:41:49.227087 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:41:49.227087 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:41:49.227087 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:41:49.227087 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:41:49.227087 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:49.227087 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 339/687] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:41:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:41:49.231834 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733c70b-40bd-494f-882e-a175ab76a9d6 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:49.233337 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 349/688] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Apr 30 20:41:48 2022] POST /identity/v3/services => generated 240 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:41:49.349225 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733c70b-40bd-494f-882e-a175ab76a9d6 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:49.396958 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a1c93-635d-4225-b05c-3397885874df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:49.396958 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a1c93-635d-4225-b05c-3397885874df None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:49.396958 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a1c93-635d-4225-b05c-3397885874df None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:49.396958 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a1c93-635d-4225-b05c-3397885874df None admin] PATH_INFO: `/v3/projects` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:49.397817 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a1c93-635d-4225-b05c-3397885874df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:49.397817 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a1c93-635d-4225-b05c-3397885874df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:49.398158 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a1c93-635d-4225-b05c-3397885874df None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:49.412651 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 340/689] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Apr 30 20:41:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:49.419241 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58642b-bb2e-4dec-9bb9-f9a1192600b9 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:49.520867 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58642b-bb2e-4dec-9bb9-f9a1192600b9 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:49.555305 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479cb41-f86b-44eb-9e46-0caa5f791a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:49.556191 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479cb41-f86b-44eb-9e46-0caa5f791a57 None admin] REQUEST_METHOD: `PUT` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:49.556468 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479cb41-f86b-44eb-9e46-0caa5f791a57 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:49.556744 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479cb41-f86b-44eb-9e46-0caa5f791a57 None admin] PATH_INFO: `/v3/projects/45ddbc3ac9ff421598cbe53e1252d289/users/2aee3a7a6b4b4d489993c131f3ae2048/roles/31b3f11a82cd4cd2823e88aa0e931323` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:49.558749 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479cb41-f86b-44eb-9e46-0caa5f791a57 None admin] RBAC: Authorizing `identity:create_grant(project_id=45ddbc3ac9ff421598cbe53e1252d289, user_id=2aee3a7a6b4b4d489993c131f3ae2048, role_id=31b3f11a82cd4cd2823e88aa0e931323)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:49.560210 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479cb41-f86b-44eb-9e46-0caa5f791a57 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:49.673353 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 350/690] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Apr 30 20:41:49 2022] PUT /identity/v3/projects/45ddbc3ac9ff421598cbe53e1252d289/users/2aee3a7a6b4b4d489993c131f3ae2048/roles/31b3f11a82cd4cd2823e88aa0e931323 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:41:50.754343 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f2e5c-0851-4d89-8ceb-391a6be581f0 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:50.755080 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f2e5c-0851-4d89-8ceb-391a6be581f0 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:50.755080 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f2e5c-0851-4d89-8ceb-391a6be581f0 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:50.756472 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 341/691] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:50.762120 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f152d-136a-4392-bbed-a8e06be85303 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:50.762623 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f152d-136a-4392-bbed-a8e06be85303 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:50.762780 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f152d-136a-4392-bbed-a8e06be85303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:50.779564 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-002f152d-136a-4392-bbed-a8e06be85303 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:50.780730 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-002f152d-136a-4392-bbed-a8e06be85303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:50.858337 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 351/692] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:50 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:41:50.881756 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f2e5c-0851-4d89-8ceb-391a6be581f0 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:50.987011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f2e5c-0851-4d89-8ceb-391a6be581f0 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:51.021263 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd8fda-d2c9-49e8-80af-d8b24213efd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:51.022055 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd8fda-d2c9-49e8-80af-d8b24213efd9 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:51.022334 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd8fda-d2c9-49e8-80af-d8b24213efd9 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:51.022608 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd8fda-d2c9-49e8-80af-d8b24213efd9 None admin] PATH_INFO: `/v3/services/image` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:51.023252 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd8fda-d2c9-49e8-80af-d8b24213efd9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:51.024614 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd8fda-d2c9-49e8-80af-d8b24213efd9 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:51.036804 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-8abd8fda-d2c9-49e8-80af-d8b24213efd9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 30 20:41:51.036804 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:51.036804 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:41:51.036804 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:41:51.036804 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:41:51.036804 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:41:51.036804 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:41:51.036804 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:41:51.036804 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Apr 30 20:41:51.036804 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:51.036804 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:41:51.036804 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:51.036804 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:51.036804 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:51.036804 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:51.036804 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:51.036804 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:51.039123 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:51.039123 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:51.039123 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:51.039123 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:51.039123 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:51.039123 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:51.039123 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:41:51.039123 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:41:51.039123 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:41:51.039123 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:41:51.039123 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:51.039123 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:51.039123 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:51.039123 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:51.039123 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:51.039123 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:51.041170 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:51.041170 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:51.041170 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:51.041170 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:51.041170 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:51.041170 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:51.041170 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:51.041170 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:51.041170 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:51.041170 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:51.041170 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:41:51.041170 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:41:51.041170 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Apr 30 20:41:51.041170 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:51.041170 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 342/693] 10.222.0.26 () {56 vars in 1105 bytes} [Sat Apr 30 20:41:50 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:51.048928 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f152d-136a-4392-bbed-a8e06be85303 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:51.145757 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f152d-136a-4392-bbed-a8e06be85303 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:51.179697 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3ff23-3070-495d-a6fe-d75221687d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:51.180360 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3ff23-3070-495d-a6fe-d75221687d34 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:51.180636 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3ff23-3070-495d-a6fe-d75221687d34 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:51.180930 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3ff23-3070-495d-a6fe-d75221687d34 None admin] PATH_INFO: `/v3/services` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:51.181625 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3ff23-3070-495d-a6fe-d75221687d34 None admin] RBAC: Adding query filter params (name=image) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:51.181926 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3ff23-3070-495d-a6fe-d75221687d34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:51.183317 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3ff23-3070-495d-a6fe-d75221687d34 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:51.189238 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 352/694] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:51.198912 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd8fda-d2c9-49e8-80af-d8b24213efd9 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:51.305395 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd8fda-d2c9-49e8-80af-d8b24213efd9 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:51.340624 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6799f-49ab-41f3-a356-c016268e0b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:51.341322 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6799f-49ab-41f3-a356-c016268e0b8c None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:51.341613 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6799f-49ab-41f3-a356-c016268e0b8c None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:51.341890 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6799f-49ab-41f3-a356-c016268e0b8c None admin] PATH_INFO: `/v3/services` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:51.342631 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab6799f-49ab-41f3-a356-c016268e0b8c None admin] RBAC: Adding query filter params (type=image) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:51.342942 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab6799f-49ab-41f3-a356-c016268e0b8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:51.344330 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab6799f-49ab-41f3-a356-c016268e0b8c None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:51.349742 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 343/695] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:51.355889 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3ff23-3070-495d-a6fe-d75221687d34 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:51.415170 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e258055-0a68-4e33-bbd7-211de6ccda5f None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:51.415485 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e258055-0a68-4e33-bbd7-211de6ccda5f None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:51.415733 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e258055-0a68-4e33-bbd7-211de6ccda5f None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:51.417398 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 344/696] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:51.424508 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287fa03-9f60-4a2e-b9ef-42402b64e275 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:51.424872 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287fa03-9f60-4a2e-b9ef-42402b64e275 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:51.425094 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287fa03-9f60-4a2e-b9ef-42402b64e275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:51.447686 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-4287fa03-9f60-4a2e-b9ef-42402b64e275 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:51.449249 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-4287fa03-9f60-4a2e-b9ef-42402b64e275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:51.466672 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3ff23-3070-495d-a6fe-d75221687d34 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:51.502142 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e2d5d-bf7f-4c29-8a4d-c5f123580415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:51.503176 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e2d5d-bf7f-4c29-8a4d-c5f123580415 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:51.503657 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e2d5d-bf7f-4c29-8a4d-c5f123580415 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:51.504166 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e2d5d-bf7f-4c29-8a4d-c5f123580415 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:51.505191 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e2d5d-bf7f-4c29-8a4d-c5f123580415 None admin] RBAC: Adding query filter params (interface=public, service_id=09a236350fba4a3997da35703827cac5, region_id=RegionOne) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:51.505705 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e2d5d-bf7f-4c29-8a4d-c5f123580415 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:51.507275 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e2d5d-bf7f-4c29-8a4d-c5f123580415 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:51.515314 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 353/697] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Apr 30 20:41:51 2022] GET /identity/v3/endpoints?service_id=09a236350fba4a3997da35703827cac5&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:51.522548 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e2d5d-bf7f-4c29-8a4d-c5f123580415 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:51.540925 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 345/698] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:51 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 30 20:41:51.559630 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4287fa03-9f60-4a2e-b9ef-42402b64e275 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:51.629876 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e2d5d-bf7f-4c29-8a4d-c5f123580415 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:51.668056 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531e612-1b1f-40de-9679-f3f975a80be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:51.668724 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531e612-1b1f-40de-9679-f3f975a80be9 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:51.669040 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531e612-1b1f-40de-9679-f3f975a80be9 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:51.669465 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531e612-1b1f-40de-9679-f3f975a80be9 None admin] PATH_INFO: `/v3/services` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:51.670031 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531e612-1b1f-40de-9679-f3f975a80be9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:51.671364 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531e612-1b1f-40de-9679-f3f975a80be9 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:51.672074 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4287fa03-9f60-4a2e-b9ef-42402b64e275 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:51.677734 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 354/699] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Apr 30 20:41:51 2022] GET /identity/v3/services => generated 1002 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 20:41:51.679247 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c92306-57c5-4eab-9463-6381f3f52632 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:51.680106 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c92306-57c5-4eab-9463-6381f3f52632 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:51.680556 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c92306-57c5-4eab-9463-6381f3f52632 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:51.682542 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 355/700] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:51.689400 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd42870-d860-42ce-ad97-197f62cf7d44 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:51.690246 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd42870-d860-42ce-ad97-197f62cf7d44 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:51.690727 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd42870-d860-42ce-ad97-197f62cf7d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:51.714179 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-6dd42870-d860-42ce-ad97-197f62cf7d44 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:51.715398 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-6dd42870-d860-42ce-ad97-197f62cf7d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:51.718762 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba608c-e1ec-4300-a89d-255de87a6f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:51.719701 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba608c-e1ec-4300-a89d-255de87a6f96 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:51.720559 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba608c-e1ec-4300-a89d-255de87a6f96 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:51.720952 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba608c-e1ec-4300-a89d-255de87a6f96 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:51.721706 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba608c-e1ec-4300-a89d-255de87a6f96 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:51.723201 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba608c-e1ec-4300-a89d-255de87a6f96 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:51.739130 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-f8ba608c-e1ec-4300-a89d-255de87a6f96 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 30 20:41:51.739130 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:51.739130 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:41:51.739130 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:41:51.739130 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:41:51.739130 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:41:51.739130 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:41:51.739130 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:41:51.739130 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 30 20:41:51.739130 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:51.739130 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:41:51.739130 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:51.739130 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:51.739130 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:51.739130 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:51.739130 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:51.740140 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:51.740140 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:51.740140 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:51.740140 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:51.740140 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:51.740140 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:51.740140 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:51.740140 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:41:51.740140 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:41:51.740140 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:41:51.740140 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:41:51.740140 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:51.740140 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:51.740140 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:51.740140 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:51.740140 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:51.741319 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:51.741319 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:51.741319 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:51.741319 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:51.741319 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:51.741319 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:51.741319 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:51.741319 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:51.741319 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:51.741319 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:51.741319 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:51.741319 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:41:51.741319 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:41:51.741319 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 30 20:41:51.741319 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:51.746253 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 346/701] 10.222.0.26 () {56 vars in 1129 bytes} [Sat Apr 30 20:41:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:41:51.746936 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba608c-e1ec-4300-a89d-255de87a6f96 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:51.805292 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 356/702] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:51 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 30 20:41:51.825033 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd42870-d860-42ce-ad97-197f62cf7d44 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:51.866093 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba608c-e1ec-4300-a89d-255de87a6f96 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:51.905578 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2e93c-0254-4eaf-9931-9d6ca20853a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:51.906258 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2e93c-0254-4eaf-9931-9d6ca20853a2 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:51.906545 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2e93c-0254-4eaf-9931-9d6ca20853a2 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:51.906815 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2e93c-0254-4eaf-9931-9d6ca20853a2 None admin] PATH_INFO: `/v3/services` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:51.907784 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2e93c-0254-4eaf-9931-9d6ca20853a2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:51.908189 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2e93c-0254-4eaf-9931-9d6ca20853a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:51.909644 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2e93c-0254-4eaf-9931-9d6ca20853a2 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:51.915574 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 347/703] 10.222.0.26 () {56 vars in 1124 bytes} [Sat Apr 30 20:41:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:41:51.921512 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2e93c-0254-4eaf-9931-9d6ca20853a2 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:51.946090 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd42870-d860-42ce-ad97-197f62cf7d44 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:51.980961 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f23ef6-503e-44c9-8403-2af75310f5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:51.982138 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f23ef6-503e-44c9-8403-2af75310f5cc None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:51.982635 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f23ef6-503e-44c9-8403-2af75310f5cc None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:51.983109 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f23ef6-503e-44c9-8403-2af75310f5cc None admin] PATH_INFO: `/v3/services/network` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:51.983945 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f23ef6-503e-44c9-8403-2af75310f5cc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:51.985735 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f23ef6-503e-44c9-8403-2af75310f5cc None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:51.997555 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-e0f23ef6-503e-44c9-8403-2af75310f5cc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 30 20:41:51.997555 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:51.997555 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:41:51.997555 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:41:51.997555 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:41:51.997555 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:41:51.997555 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:41:51.997555 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:41:51.997555 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Apr 30 20:41:51.997555 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:51.997555 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:41:51.997555 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:51.997555 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:51.997555 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:51.997555 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:51.997555 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:51.997555 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:51.998549 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:51.998549 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:51.998549 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:51.998549 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:51.998549 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:51.998549 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:51.998549 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:41:51.998549 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:41:51.998549 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:41:51.998549 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:41:51.998549 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:51.998549 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:51.998549 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:51.998549 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:51.998549 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:51.998549 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:51.999393 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:51.999393 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:51.999393 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:51.999393 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:51.999393 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:51.999393 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:51.999393 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:51.999393 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:51.999393 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:51.999393 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:51.999393 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:41:51.999393 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:41:51.999393 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Apr 30 20:41:51.999393 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:52.002804 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 357/704] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:41:51 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:52.008812 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f23ef6-503e-44c9-8403-2af75310f5cc None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:52.038647 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2e93c-0254-4eaf-9931-9d6ca20853a2 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:52.075295 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ab199-ef0f-4890-b42e-c50555535ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:52.076344 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ab199-ef0f-4890-b42e-c50555535ab2 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:52.076881 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ab199-ef0f-4890-b42e-c50555535ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:52.077382 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ab199-ef0f-4890-b42e-c50555535ab2 None admin] PATH_INFO: `/v3/services` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:52.078288 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ab199-ef0f-4890-b42e-c50555535ab2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:52.078806 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ab199-ef0f-4890-b42e-c50555535ab2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:52.080716 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ab199-ef0f-4890-b42e-c50555535ab2 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:52.088247 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 348/705] 10.222.0.26 () {56 vars in 1124 bytes} [Sat Apr 30 20:41:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:41:52.094345 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ab199-ef0f-4890-b42e-c50555535ab2 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:52.130001 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f23ef6-503e-44c9-8403-2af75310f5cc None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:52.163719 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d33065-5049-4cf9-830d-d61143b4a17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:52.164377 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d33065-5049-4cf9-830d-d61143b4a17a None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:52.164656 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d33065-5049-4cf9-830d-d61143b4a17a None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:52.165000 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d33065-5049-4cf9-830d-d61143b4a17a None admin] PATH_INFO: `/v3/services` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:52.165644 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d33065-5049-4cf9-830d-d61143b4a17a None admin] RBAC: Adding query filter params (name=network) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:52.165949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d33065-5049-4cf9-830d-d61143b4a17a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:52.167328 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d33065-5049-4cf9-830d-d61143b4a17a None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:52.172015 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 358/706] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Apr 30 20:41:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:52.173201 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87759756-098f-4e49-9877-9a7718997bcb None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:52.173490 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87759756-098f-4e49-9877-9a7718997bcb None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:52.173817 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87759756-098f-4e49-9877-9a7718997bcb None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:52.179164 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 359/707] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:52.179164 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87759756-098f-4e49-9877-9a7718997bcb None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:52.196322 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ab199-ef0f-4890-b42e-c50555535ab2 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:52.228765 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b970c-b1ea-40f3-a089-aec1a7815eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:52.229564 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b970c-b1ea-40f3-a089-aec1a7815eed None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:52.229847 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b970c-b1ea-40f3-a089-aec1a7815eed None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:52.230115 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b970c-b1ea-40f3-a089-aec1a7815eed None admin] PATH_INFO: `/v3/endpoints` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:52.230883 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b970c-b1ea-40f3-a089-aec1a7815eed None admin] RBAC: Adding query filter params (interface=public, service_id=168b1508e38141be9b092c98f483b06b, region_id=RegionOne) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:52.231195 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b970c-b1ea-40f3-a089-aec1a7815eed None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:52.232566 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b970c-b1ea-40f3-a089-aec1a7815eed None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:52.244573 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 349/708] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Apr 30 20:41:52 2022] GET /identity/v3/endpoints?service_id=168b1508e38141be9b092c98f483b06b&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:52.244573 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58371e-5440-44eb-aa58-ad4f3ca2013b None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:52.244573 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58371e-5440-44eb-aa58-ad4f3ca2013b None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:52.244573 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58371e-5440-44eb-aa58-ad4f3ca2013b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:52.259642 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-ba58371e-5440-44eb-aa58-ad4f3ca2013b None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:52.260817 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-ba58371e-5440-44eb-aa58-ad4f3ca2013b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:52.284755 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87759756-098f-4e49-9877-9a7718997bcb None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:52.319396 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4db96-b382-4965-91c2-9216ff0f4966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:52.320049 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4db96-b382-4965-91c2-9216ff0f4966 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:52.320326 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4db96-b382-4965-91c2-9216ff0f4966 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:52.320599 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4db96-b382-4965-91c2-9216ff0f4966 None admin] PATH_INFO: `/v3/services` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:52.321314 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4db96-b382-4965-91c2-9216ff0f4966 None admin] RBAC: Adding query filter params (type=network) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:52.321614 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4db96-b382-4965-91c2-9216ff0f4966 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:52.322986 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4db96-b382-4965-91c2-9216ff0f4966 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:52.333307 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 360/709] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Apr 30 20:41:52 2022] GET /identity/v3/services?type=network => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:52.333307 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4db96-b382-4965-91c2-9216ff0f4966 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:52.337038 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 350/710] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:52 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:41:52.338051 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58371e-5440-44eb-aa58-ad4f3ca2013b None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:52.438029 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58371e-5440-44eb-aa58-ad4f3ca2013b None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:52.440355 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4db96-b382-4965-91c2-9216ff0f4966 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:52.471463 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62fa6f8-23a2-480a-b176-6d9ffc8bef64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:52.477137 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fa6f8-23a2-480a-b176-6d9ffc8bef64 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:52.477137 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fa6f8-23a2-480a-b176-6d9ffc8bef64 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:52.477137 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fa6f8-23a2-480a-b176-6d9ffc8bef64 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:52.477375 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d507c3d-938e-43c7-b0f1-81ff2f875797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:52.477478 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62fa6f8-23a2-480a-b176-6d9ffc8bef64 None admin] RBAC: Adding query filter params (interface=public, service_id=e6a9a66d85ef4cf0857a4f23d525cd27, region_id=RegionOne) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:52.477553 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d507c3d-938e-43c7-b0f1-81ff2f875797 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:52.477553 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d507c3d-938e-43c7-b0f1-81ff2f875797 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:52.477674 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62fa6f8-23a2-480a-b176-6d9ffc8bef64 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:52.477749 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d507c3d-938e-43c7-b0f1-81ff2f875797 None admin] PATH_INFO: `/v3/services` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:52.477749 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d507c3d-938e-43c7-b0f1-81ff2f875797 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:52.477906 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62fa6f8-23a2-480a-b176-6d9ffc8bef64 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:52.477988 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d507c3d-938e-43c7-b0f1-81ff2f875797 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:52.484965 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 361/711] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Apr 30 20:41:52 2022] GET /identity/v3/services => generated 1002 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 20:41:52.484965 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d507c3d-938e-43c7-b0f1-81ff2f875797 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:52.493297 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 351/712] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Apr 30 20:41:52 2022] GET /identity/v3/endpoints?service_id=e6a9a66d85ef4cf0857a4f23d525cd27&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:52.501609 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62fa6f8-23a2-480a-b176-6d9ffc8bef64 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:52.616523 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d507c3d-938e-43c7-b0f1-81ff2f875797 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:52.621899 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62fa6f8-23a2-480a-b176-6d9ffc8bef64 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:52.654578 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2ea28-90cd-4c3c-bbfe-dd986e36531b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:52.655575 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2ea28-90cd-4c3c-bbfe-dd986e36531b None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:52.655963 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2ea28-90cd-4c3c-bbfe-dd986e36531b None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:52.656338 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2ea28-90cd-4c3c-bbfe-dd986e36531b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:52.661963 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e95ec-8736-4ede-90ad-d8cb2b4cbbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:52.662643 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e95ec-8736-4ede-90ad-d8cb2b4cbbf8 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:52.662928 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e95ec-8736-4ede-90ad-d8cb2b4cbbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:52.663202 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e95ec-8736-4ede-90ad-d8cb2b4cbbf8 None admin] PATH_INFO: `/v3/services` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:52.663891 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e95ec-8736-4ede-90ad-d8cb2b4cbbf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:52.665318 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e95ec-8736-4ede-90ad-d8cb2b4cbbf8 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:52.670236 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2ea28-90cd-4c3c-bbfe-dd986e36531b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:41:52.671639 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 352/713] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Apr 30 20:41:52 2022] GET /identity/v3/services => generated 1002 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 20:41:52.684444 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-82f2ea28-90cd-4c3c-bbfe-dd986e36531b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:41:52.684444 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:52.684444 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:52.684444 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:52.684444 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:52.684444 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:52.684444 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:52.684444 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:52.684444 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:52.684444 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:52.684444 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:52.684444 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:52.684444 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:41:52.684444 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:41:52.684444 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:41:52.684444 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:41:52.685639 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:41:52.685639 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:41:52.685639 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:41:52.685639 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:41:52.685639 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:52.685639 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:52.685639 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:52.685639 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:52.685639 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:52.685639 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:52.685639 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:52.685639 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:52.685639 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:52.685639 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:52.685639 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:52.685639 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:52.686656 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:52.686656 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:52.686656 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:52.686656 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:52.686656 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:41:52.686656 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:41:52.686656 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:41:52.686656 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:41:52.686656 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:41:52.686656 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:41:52.686656 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:41:52.686656 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:52.689060 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 362/714] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Apr 30 20:41:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:52.695134 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e95ec-8736-4ede-90ad-d8cb2b4cbbf8 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:52.804362 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e95ec-8736-4ede-90ad-d8cb2b4cbbf8 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:52.842436 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a9178-2866-4102-8c30-b15dfdd66274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:52.843122 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a9178-2866-4102-8c30-b15dfdd66274 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:52.843403 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a9178-2866-4102-8c30-b15dfdd66274 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:52.843670 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a9178-2866-4102-8c30-b15dfdd66274 None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:52.844431 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a9178-2866-4102-8c30-b15dfdd66274 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:52.844780 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a9178-2866-4102-8c30-b15dfdd66274 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:52.846541 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a9178-2866-4102-8c30-b15dfdd66274 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:52.861021 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 353/715] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:41:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:52.862884 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2ea28-90cd-4c3c-bbfe-dd986e36531b None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:52.969089 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2ea28-90cd-4c3c-bbfe-dd986e36531b None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:53.004298 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39873f79-1baf-4e7a-8e8a-61ad0fc7e6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:53.005123 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39873f79-1baf-4e7a-8e8a-61ad0fc7e6bb None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:53.005409 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39873f79-1baf-4e7a-8e8a-61ad0fc7e6bb None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:53.005689 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39873f79-1baf-4e7a-8e8a-61ad0fc7e6bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:53.016516 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39873f79-1baf-4e7a-8e8a-61ad0fc7e6bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:53.018030 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39873f79-1baf-4e7a-8e8a-61ad0fc7e6bb None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:53.034839 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-39873f79-1baf-4e7a-8e8a-61ad0fc7e6bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:53.034839 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:53.034839 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:53.034839 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:53.034839 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:53.034839 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:53.034839 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:53.034839 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:53.034839 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:53.034839 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:53.034839 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:53.034839 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:53.034839 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:41:53.034839 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:41:53.034839 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:41:53.035745 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:41:53.035745 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:53.035745 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:53.035745 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:53.035745 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:53.035745 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:53.035745 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:53.035745 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:53.035745 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:53.035745 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:53.035745 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:53.035745 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:53.035745 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:53.035745 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:53.035745 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:53.035745 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:53.035745 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:53.036628 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:41:53.036628 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:41:53.036628 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:53.036628 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:53.040576 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 363/716] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:53.041934 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a9178-2866-4102-8c30-b15dfdd66274 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:53.144429 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a9178-2866-4102-8c30-b15dfdd66274 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:53.178707 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd879b4-db45-49b4-9601-f1be6082dcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:53.179368 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd879b4-db45-49b4-9601-f1be6082dcbf None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:53.179651 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd879b4-db45-49b4-9601-f1be6082dcbf None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:53.179929 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd879b4-db45-49b4-9601-f1be6082dcbf None admin] PATH_INFO: `/v3/domains` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:53.180639 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd879b4-db45-49b4-9601-f1be6082dcbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:53.180975 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd879b4-db45-49b4-9601-f1be6082dcbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:53.182340 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd879b4-db45-49b4-9601-f1be6082dcbf None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:53.199155 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 354/717] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:53.200512 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39873f79-1baf-4e7a-8e8a-61ad0fc7e6bb None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:53.301518 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39873f79-1baf-4e7a-8e8a-61ad0fc7e6bb None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:53.335873 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4cd665-bc6e-43dd-816b-b685215f0fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:53.336672 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4cd665-bc6e-43dd-816b-b685215f0fd2 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:53.336971 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4cd665-bc6e-43dd-816b-b685215f0fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:53.337250 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4cd665-bc6e-43dd-816b-b685215f0fd2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:53.345374 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4cd665-bc6e-43dd-816b-b685215f0fd2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:53.346822 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4cd665-bc6e-43dd-816b-b685215f0fd2 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:53.361314 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-ef4cd665-bc6e-43dd-816b-b685215f0fd2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 30 20:41:53.361314 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:53.361314 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:53.361314 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:53.361314 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:53.361314 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:53.361314 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:53.361314 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:53.361314 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:53.361314 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:53.361314 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:53.361314 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:53.361314 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:41:53.361314 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:41:53.361314 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:41:53.361314 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:41:53.363595 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:53.363595 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:53.363595 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:41:53.363595 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:41:53.363595 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:41:53.363595 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:41:53.363595 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:53.363595 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:53.363595 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:53.363595 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:53.363595 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:53.363595 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:53.363595 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:53.363595 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:53.363595 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:53.363595 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:53.363595 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:53.363595 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:53.364760 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:53.364760 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:53.364760 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:41:53.364760 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:41:53.364760 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:41:53.364760 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:41:53.364760 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:41:53.364760 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:41:53.364760 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Apr 30 20:41:53.364760 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:53.364760 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 364/718] 10.222.0.26 () {56 vars in 1093 bytes} [Sat Apr 30 20:41:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:53.368338 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd879b4-db45-49b4-9601-f1be6082dcbf None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:53.471163 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd879b4-db45-49b4-9601-f1be6082dcbf None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:53.505680 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8d6fa-7f40-444a-8bf1-dd8836ce17c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:53.506349 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8d6fa-7f40-444a-8bf1-dd8836ce17c2 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:53.506629 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8d6fa-7f40-444a-8bf1-dd8836ce17c2 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:53.506906 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8d6fa-7f40-444a-8bf1-dd8836ce17c2 None admin] PATH_INFO: `/v3/users` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:53.507741 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8d6fa-7f40-444a-8bf1-dd8836ce17c2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:53.508048 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8d6fa-7f40-444a-8bf1-dd8836ce17c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:53.509575 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8d6fa-7f40-444a-8bf1-dd8836ce17c2 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:53.527659 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 355/719] 10.222.0.26 () {56 vars in 1133 bytes} [Sat Apr 30 20:41:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:53.533310 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4cd665-bc6e-43dd-816b-b685215f0fd2 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:53.637619 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4cd665-bc6e-43dd-816b-b685215f0fd2 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:53.672702 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea5cce-0186-4209-8c88-3f7cb4aa4479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:53.674138 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea5cce-0186-4209-8c88-3f7cb4aa4479 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:53.674407 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea5cce-0186-4209-8c88-3f7cb4aa4479 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:53.674679 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea5cce-0186-4209-8c88-3f7cb4aa4479 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:53.745262 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea5cce-0186-4209-8c88-3f7cb4aa4479 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:53.746712 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea5cce-0186-4209-8c88-3f7cb4aa4479 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:53.859519 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 365/720] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:41:53 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 30 20:41:53.865046 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8d6fa-7f40-444a-8bf1-dd8836ce17c2 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:53.974020 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8d6fa-7f40-444a-8bf1-dd8836ce17c2 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:54.008654 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98783f5c-a2e1-41e2-ba59-4e5f8f3b37ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:54.009498 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98783f5c-a2e1-41e2-ba59-4e5f8f3b37ee None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:54.009865 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98783f5c-a2e1-41e2-ba59-4e5f8f3b37ee None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:54.010072 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98783f5c-a2e1-41e2-ba59-4e5f8f3b37ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:54.021488 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98783f5c-a2e1-41e2-ba59-4e5f8f3b37ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:54.022955 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98783f5c-a2e1-41e2-ba59-4e5f8f3b37ee None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:54.041255 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-98783f5c-a2e1-41e2-ba59-4e5f8f3b37ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:54.041255 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:54.041255 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:54.041255 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:54.041255 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:54.041255 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:54.041255 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:54.041255 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:54.041255 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:54.041255 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:54.041255 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:54.041255 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:54.041255 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:41:54.041255 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:41:54.041255 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:41:54.042625 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:41:54.042625 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:54.042625 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:54.042625 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:54.042625 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:54.042625 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:54.042625 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:54.042625 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:54.042625 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:54.042625 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:54.042625 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:54.042625 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:54.042625 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:54.042625 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:54.042625 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:54.042625 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:54.042625 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:54.043522 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:41:54.043522 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:41:54.043522 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:54.043522 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:54.043522 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 356/721] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:54.050164 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea5cce-0186-4209-8c88-3f7cb4aa4479 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:54.123624 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527b5f9-2351-4be8-b715-48d7e2a4bcae None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:54.123987 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527b5f9-2351-4be8-b715-48d7e2a4bcae None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:54.124186 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527b5f9-2351-4be8-b715-48d7e2a4bcae None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:54.125834 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 357/722] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:41:54.132774 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96dae6c-148a-4a3f-9110-1680f43f254e None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:54.133202 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96dae6c-148a-4a3f-9110-1680f43f254e None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:54.133586 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96dae6c-148a-4a3f-9110-1680f43f254e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:54.151595 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-a96dae6c-148a-4a3f-9110-1680f43f254e None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:54.152798 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-a96dae6c-148a-4a3f-9110-1680f43f254e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:54.153481 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea5cce-0186-4209-8c88-3f7cb4aa4479 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:54.189221 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5f19e-0bb2-4b73-b00a-a47a4d0b60b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:54.190223 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5f19e-0bb2-4b73-b00a-a47a4d0b60b7 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:54.190510 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5f19e-0bb2-4b73-b00a-a47a4d0b60b7 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:54.190787 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5f19e-0bb2-4b73-b00a-a47a4d0b60b7 None admin] PATH_INFO: `/v3/domains` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:54.191505 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5f19e-0bb2-4b73-b00a-a47a4d0b60b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:54.191814 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5f19e-0bb2-4b73-b00a-a47a4d0b60b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:54.193226 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5f19e-0bb2-4b73-b00a-a47a4d0b60b7 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:54.210270 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 366/723] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:54.212543 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5f19e-0bb2-4b73-b00a-a47a4d0b60b7 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:54.233000 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 358/724] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:54 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:41:54.251602 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96dae6c-148a-4a3f-9110-1680f43f254e None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:54.339685 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5f19e-0bb2-4b73-b00a-a47a4d0b60b7 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:54.373599 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96dae6c-148a-4a3f-9110-1680f43f254e None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:54.383144 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd2038-9ecf-4a84-8502-93eb87f98609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:54.384272 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd2038-9ecf-4a84-8502-93eb87f98609 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:54.384758 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd2038-9ecf-4a84-8502-93eb87f98609 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:54.385680 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd2038-9ecf-4a84-8502-93eb87f98609 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:54.394928 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd2038-9ecf-4a84-8502-93eb87f98609 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:54.397104 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd2038-9ecf-4a84-8502-93eb87f98609 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:54.411855 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103c0b2-492e-4b14-8842-a20ee50c981f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:54.412752 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103c0b2-492e-4b14-8842-a20ee50c981f None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:54.413153 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103c0b2-492e-4b14-8842-a20ee50c981f None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:54.413458 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103c0b2-492e-4b14-8842-a20ee50c981f None admin] PATH_INFO: `/v3/services/image` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:54.414168 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103c0b2-492e-4b14-8842-a20ee50c981f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:54.415566 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103c0b2-492e-4b14-8842-a20ee50c981f None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:54.418843 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-ebdd2038-9ecf-4a84-8502-93eb87f98609 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:41:54.418843 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:54.418843 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:54.418843 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:54.418843 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:54.418843 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:54.418843 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:54.418843 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:54.418843 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:54.418843 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:54.418843 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:54.418843 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:54.418843 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:41:54.418843 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:41:54.418843 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:41:54.419787 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:41:54.419787 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:54.419787 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:54.419787 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:54.419787 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:54.419787 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:54.419787 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:54.419787 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:54.419787 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:54.419787 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:54.419787 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:54.419787 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:54.419787 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:54.419787 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:54.419787 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:54.419787 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:54.419787 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:54.420664 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:41:54.420664 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:41:54.420664 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:41:54.420664 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:41:54.420664 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:41:54.420664 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:41:54.420664 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:41:54.420664 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:54.427949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 367/725] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:41:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:41:54.429809 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd2038-9ecf-4a84-8502-93eb87f98609 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:54.437205 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-b103c0b2-492e-4b14-8842-a20ee50c981f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 30 20:41:54.437205 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:54.437205 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:41:54.437205 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:41:54.437205 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:41:54.437205 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:41:54.437205 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:41:54.437205 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:41:54.437205 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Apr 30 20:41:54.437205 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:54.437205 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:41:54.437205 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:54.437205 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:54.437205 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:54.437205 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:54.437205 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:54.437205 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:54.438194 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:54.438194 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:54.438194 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:54.438194 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:54.438194 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:54.438194 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:54.438194 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:41:54.438194 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:41:54.438194 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:41:54.438194 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:41:54.438194 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:54.438194 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:54.438194 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:54.438194 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:54.438194 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:54.438194 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:54.439889 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:54.439889 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:54.439889 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:54.439889 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:54.439889 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:54.439889 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:54.439889 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:54.439889 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:54.439889 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:54.439889 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:54.439889 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:41:54.439889 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:41:54.439889 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Apr 30 20:41:54.439889 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:54.444716 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 359/726] 10.222.0.26 () {56 vars in 1105 bytes} [Sat Apr 30 20:41:54 2022] GET /identity/v3/services/image => generated 86 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:41:54.445671 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103c0b2-492e-4b14-8842-a20ee50c981f None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:54.556554 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd2038-9ecf-4a84-8502-93eb87f98609 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:54.571535 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103c0b2-492e-4b14-8842-a20ee50c981f None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:54.605872 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06963ffa-cfb6-4039-8bcc-90cbdd248440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:54.606896 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06963ffa-cfb6-4039-8bcc-90cbdd248440 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:54.607382 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06963ffa-cfb6-4039-8bcc-90cbdd248440 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:54.607886 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06963ffa-cfb6-4039-8bcc-90cbdd248440 None admin] PATH_INFO: `/v3/projects` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:54.608390 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4674186-7cc5-4d9e-b7ee-36a9bb3dce46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:54.609093 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4674186-7cc5-4d9e-b7ee-36a9bb3dce46 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:54.609381 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4674186-7cc5-4d9e-b7ee-36a9bb3dce46 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:54.609485 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06963ffa-cfb6-4039-8bcc-90cbdd248440 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:54.609660 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4674186-7cc5-4d9e-b7ee-36a9bb3dce46 None admin] PATH_INFO: `/v3/services` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:54.610168 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06963ffa-cfb6-4039-8bcc-90cbdd248440 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:54.610926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4674186-7cc5-4d9e-b7ee-36a9bb3dce46 None admin] RBAC: Adding query filter params (name=image) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:54.611352 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4674186-7cc5-4d9e-b7ee-36a9bb3dce46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:54.612879 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06963ffa-cfb6-4039-8bcc-90cbdd248440 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:54.613026 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4674186-7cc5-4d9e-b7ee-36a9bb3dce46 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:54.622499 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 360/727] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:54.623414 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4674186-7cc5-4d9e-b7ee-36a9bb3dce46 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:54.628682 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 368/728] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Apr 30 20:41:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:54.633301 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06963ffa-cfb6-4039-8bcc-90cbdd248440 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:54.741640 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06963ffa-cfb6-4039-8bcc-90cbdd248440 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:54.755476 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4674186-7cc5-4d9e-b7ee-36a9bb3dce46 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:54.789227 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7a60b-5e19-4fc7-bf83-6e2f28d2abb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:54.790268 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7a60b-5e19-4fc7-bf83-6e2f28d2abb4 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:54.790814 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7a60b-5e19-4fc7-bf83-6e2f28d2abb4 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:54.791292 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819cb627-eb5e-4980-912c-e3322fd4abcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:54.791539 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7a60b-5e19-4fc7-bf83-6e2f28d2abb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:54.791956 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cb627-eb5e-4980-912c-e3322fd4abcc None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:54.792240 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cb627-eb5e-4980-912c-e3322fd4abcc None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:54.792516 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cb627-eb5e-4980-912c-e3322fd4abcc None admin] PATH_INFO: `/v3/services` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:54.793255 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7a60b-5e19-4fc7-bf83-6e2f28d2abb4 None admin] RBAC: Adding query filter params (role.id=31b3f11a82cd4cd2823e88aa0e931323, scope.project.id=45ddbc3ac9ff421598cbe53e1252d289, user.id=2aee3a7a6b4b4d489993c131f3ae2048) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:54.793360 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819cb627-eb5e-4980-912c-e3322fd4abcc None admin] RBAC: Adding query filter params (type=image) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:54.793615 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819cb627-eb5e-4980-912c-e3322fd4abcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:54.794104 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7a60b-5e19-4fc7-bf83-6e2f28d2abb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:54.795002 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819cb627-eb5e-4980-912c-e3322fd4abcc None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:54.795972 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7a60b-5e19-4fc7-bf83-6e2f28d2abb4 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:54.804153 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 369/730] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Apr 30 20:41:54 2022] GET /identity/v3/role_assignments?user.id=2aee3a7a6b4b4d489993c131f3ae2048&scope.project.id=45ddbc3ac9ff421598cbe53e1252d289&role.id=31b3f11a82cd4cd2823e88aa0e931323 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:41:54.804982 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 361/730] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:54.818138 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7a60b-5e19-4fc7-bf83-6e2f28d2abb4 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:54.930064 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7a60b-5e19-4fc7-bf83-6e2f28d2abb4 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:54.932049 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f66d3-d8ed-48d9-b0cf-ce1efed72029 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:54.932334 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f66d3-d8ed-48d9-b0cf-ce1efed72029 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:54.932612 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f66d3-d8ed-48d9-b0cf-ce1efed72029 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:54.934571 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 362/731] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:41:54.940458 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7e304-eb3b-4b25-bda7-00fa82322c34 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:54.940830 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7e304-eb3b-4b25-bda7-00fa82322c34 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:54.941054 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7e304-eb3b-4b25-bda7-00fa82322c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:54.959571 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-1af7e304-eb3b-4b25-bda7-00fa82322c34 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:54.960822 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-1af7e304-eb3b-4b25-bda7-00fa82322c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:54.982737 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991cbfe-e000-4ed7-8af7-df0160770b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:54.983948 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991cbfe-e000-4ed7-8af7-df0160770b06 None admin] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:54.984998 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991cbfe-e000-4ed7-8af7-df0160770b06 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:54.985780 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991cbfe-e000-4ed7-8af7-df0160770b06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:54.986862 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991cbfe-e000-4ed7-8af7-df0160770b06 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:54.989155 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991cbfe-e000-4ed7-8af7-df0160770b06 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:55.038233 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 363/732] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:54 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 30 20:41:55.061846 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7e304-eb3b-4b25-bda7-00fa82322c34 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:55.087481 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 370/733] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Apr 30 20:41:54 2022] POST /identity/v3/endpoints => generated 327 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:41:55.148640 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f8ff2-782b-43f8-967f-d38952908e28 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:55.148988 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f8ff2-782b-43f8-967f-d38952908e28 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:55.149272 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f8ff2-782b-43f8-967f-d38952908e28 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:55.151031 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 371/734] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:55.158149 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1ea12-7c26-425a-a3b2-7512c9ec0786 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:55.158440 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1ea12-7c26-425a-a3b2-7512c9ec0786 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:55.158727 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1ea12-7c26-425a-a3b2-7512c9ec0786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:55.178767 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-75c1ea12-7c26-425a-a3b2-7512c9ec0786 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:55.180052 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-75c1ea12-7c26-425a-a3b2-7512c9ec0786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:55.182014 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7e304-eb3b-4b25-bda7-00fa82322c34 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:55.227037 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad176276-0df5-48a8-868b-6ff3e8e81b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:55.227871 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad176276-0df5-48a8-868b-6ff3e8e81b9e None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:55.228151 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad176276-0df5-48a8-868b-6ff3e8e81b9e None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:55.228425 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad176276-0df5-48a8-868b-6ff3e8e81b9e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:55.229126 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad176276-0df5-48a8-868b-6ff3e8e81b9e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:55.230559 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad176276-0df5-48a8-868b-6ff3e8e81b9e None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:55.244406 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-ad176276-0df5-48a8-868b-6ff3e8e81b9e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 30 20:41:55.244406 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:55.244406 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:41:55.244406 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:41:55.244406 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:41:55.244406 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:41:55.244406 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:41:55.244406 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:41:55.244406 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 30 20:41:55.244406 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:55.244406 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:41:55.244406 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:55.244406 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:55.244406 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:55.244406 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:55.244406 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:55.245609 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:55.245609 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:55.245609 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:55.245609 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:55.245609 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:55.245609 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:55.245609 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:55.245609 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:41:55.245609 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:41:55.245609 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:41:55.245609 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:41:55.245609 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:55.245609 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:55.245609 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:55.245609 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:55.245609 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:55.246743 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:55.246743 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:55.246743 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:55.246743 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:55.246743 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:55.246743 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:55.246743 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:55.246743 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:55.246743 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:55.246743 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:55.246743 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:55.246743 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:41:55.246743 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:41:55.246743 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 30 20:41:55.246743 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:55.246743 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 364/735] 10.222.0.26 () {56 vars in 1129 bytes} [Sat Apr 30 20:41:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:41:55.254191 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad176276-0df5-48a8-868b-6ff3e8e81b9e None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:55.258721 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 372/736] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:55 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:41:55.289160 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1ea12-7c26-425a-a3b2-7512c9ec0786 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:55.369652 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad176276-0df5-48a8-868b-6ff3e8e81b9e None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:55.403791 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3cc3e-a8c3-49ed-8734-27073e43939a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:55.404503 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3cc3e-a8c3-49ed-8734-27073e43939a None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:55.404787 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3cc3e-a8c3-49ed-8734-27073e43939a None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:55.405099 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3cc3e-a8c3-49ed-8734-27073e43939a None admin] PATH_INFO: `/v3/services` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:55.405820 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3cc3e-a8c3-49ed-8734-27073e43939a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:55.406113 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3cc3e-a8c3-49ed-8734-27073e43939a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:55.411615 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3cc3e-a8c3-49ed-8734-27073e43939a None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:55.416794 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 365/737] 10.222.0.26 () {56 vars in 1124 bytes} [Sat Apr 30 20:41:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:55.418568 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1ea12-7c26-425a-a3b2-7512c9ec0786 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:55.422193 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3cc3e-a8c3-49ed-8734-27073e43939a None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:55.461349 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07d656-3961-478a-baea-9375468993a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:55.462803 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07d656-3961-478a-baea-9375468993a6 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:55.463323 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07d656-3961-478a-baea-9375468993a6 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:55.464127 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07d656-3961-478a-baea-9375468993a6 None admin] PATH_INFO: `/v3/services/network` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:55.464954 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a07d656-3961-478a-baea-9375468993a6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:55.467017 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a07d656-3961-478a-baea-9375468993a6 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:55.482684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-4a07d656-3961-478a-baea-9375468993a6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 30 20:41:55.482684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:55.482684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:41:55.482684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:41:55.482684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:41:55.482684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:41:55.482684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:41:55.482684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:41:55.482684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Apr 30 20:41:55.482684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:55.482684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:41:55.482684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:55.482684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:55.482684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:55.482684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:55.482684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:55.482684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:55.483904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:55.483904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:55.483904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:55.483904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:55.483904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:55.483904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:55.483904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:41:55.483904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:41:55.483904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:41:55.483904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:41:55.483904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:55.483904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:55.483904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:55.483904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:55.483904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:55.483904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:55.484930 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:55.484930 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:55.484930 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:55.484930 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:55.484930 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:55.484930 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:55.484930 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:55.484930 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:55.484930 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:55.484930 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:55.484930 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:41:55.484930 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:41:55.484930 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Apr 30 20:41:55.484930 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:41:55.486268 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 373/738] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:41:55 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:41:55.501650 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07d656-3961-478a-baea-9375468993a6 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:55.528831 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3cc3e-a8c3-49ed-8734-27073e43939a None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:55.564784 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccfec8-8f18-459a-9883-3fbd9c7ad674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:55.565508 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccfec8-8f18-459a-9883-3fbd9c7ad674 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:55.565761 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccfec8-8f18-459a-9883-3fbd9c7ad674 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:55.566047 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccfec8-8f18-459a-9883-3fbd9c7ad674 None admin] PATH_INFO: `/v3/services` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:55.566742 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ccfec8-8f18-459a-9883-3fbd9c7ad674 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:55.567049 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ccfec8-8f18-459a-9883-3fbd9c7ad674 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:55.568426 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ccfec8-8f18-459a-9883-3fbd9c7ad674 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:55.577231 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 366/739] 10.222.0.26 () {56 vars in 1124 bytes} [Sat Apr 30 20:41:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:41:55.579778 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccfec8-8f18-459a-9883-3fbd9c7ad674 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:55.603875 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07d656-3961-478a-baea-9375468993a6 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:55.638400 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09fa5b-1149-4af4-a589-4eff967685b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:55.639277 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09fa5b-1149-4af4-a589-4eff967685b0 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:55.639708 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09fa5b-1149-4af4-a589-4eff967685b0 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:55.640138 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09fa5b-1149-4af4-a589-4eff967685b0 None admin] PATH_INFO: `/v3/services` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:55.641022 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09fa5b-1149-4af4-a589-4eff967685b0 None admin] RBAC: Adding query filter params (name=network) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:55.641547 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09fa5b-1149-4af4-a589-4eff967685b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:55.643184 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09fa5b-1149-4af4-a589-4eff967685b0 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:55.652603 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 374/740] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Apr 30 20:41:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:41:55.654008 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09fa5b-1149-4af4-a589-4eff967685b0 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:55.684265 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccfec8-8f18-459a-9883-3fbd9c7ad674 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:55.718947 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49656467-1aa5-40d3-875f-65da777997b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:55.719604 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49656467-1aa5-40d3-875f-65da777997b9 None admin] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:55.720411 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49656467-1aa5-40d3-875f-65da777997b9 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:55.720695 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49656467-1aa5-40d3-875f-65da777997b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:55.721536 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49656467-1aa5-40d3-875f-65da777997b9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:55.722966 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49656467-1aa5-40d3-875f-65da777997b9 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:55.757245 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09fa5b-1149-4af4-a589-4eff967685b0 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:55.790597 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16563c0-1423-4367-ba40-d55be8d9fa7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:55.791255 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16563c0-1423-4367-ba40-d55be8d9fa7e None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:55.791538 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16563c0-1423-4367-ba40-d55be8d9fa7e None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:55.791813 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16563c0-1423-4367-ba40-d55be8d9fa7e None admin] PATH_INFO: `/v3/services` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:55.792504 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16563c0-1423-4367-ba40-d55be8d9fa7e None admin] RBAC: Adding query filter params (type=network) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:55.792821 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16563c0-1423-4367-ba40-d55be8d9fa7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:55.794221 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16563c0-1423-4367-ba40-d55be8d9fa7e None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:55.799952 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 375/741] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Apr 30 20:41:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:41:55.806514 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16563c0-1423-4367-ba40-d55be8d9fa7e None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:55.811891 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 367/742] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Apr 30 20:41:55 2022] POST /identity/v3/endpoints => generated 346 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:41:55.927025 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16563c0-1423-4367-ba40-d55be8d9fa7e None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:55.969054 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b184cbe-851e-4455-b05c-e31a9bc3ea77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:55.970974 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b184cbe-851e-4455-b05c-e31a9bc3ea77 None admin] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:55.971469 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b184cbe-851e-4455-b05c-e31a9bc3ea77 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:55.971975 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b184cbe-851e-4455-b05c-e31a9bc3ea77 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:55.972942 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b184cbe-851e-4455-b05c-e31a9bc3ea77 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:55.974658 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b184cbe-851e-4455-b05c-e31a9bc3ea77 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:56.057155 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 376/743] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Apr 30 20:41:55 2022] POST /identity/v3/endpoints => generated 327 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 20:41:57.309457 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a62f37-98e8-479e-b107-6758816d9f74 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:57.310017 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a62f37-98e8-479e-b107-6758816d9f74 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:57.310017 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a62f37-98e8-479e-b107-6758816d9f74 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:57.311401 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 368/744] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:41:57.318066 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b44f5b-273e-4644-b882-f23e401a3648 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:57.318563 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b44f5b-273e-4644-b882-f23e401a3648 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:57.318636 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b44f5b-273e-4644-b882-f23e401a3648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:57.336237 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-44b44f5b-273e-4644-b882-f23e401a3648 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:57.337473 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-44b44f5b-273e-4644-b882-f23e401a3648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:57.409650 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 377/745] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:57 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:41:57.435733 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a62f37-98e8-479e-b107-6758816d9f74 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:57.477167 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b0b0f-744e-48e1-aaee-a8ddf48e8d54 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:57.477471 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b0b0f-744e-48e1-aaee-a8ddf48e8d54 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:57.477721 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b0b0f-744e-48e1-aaee-a8ddf48e8d54 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:57.479201 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 378/746] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:41:57.483956 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6db9b-d403-4de2-aaa9-289c345615f2 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:57.484244 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6db9b-d403-4de2-aaa9-289c345615f2 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:57.484520 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6db9b-d403-4de2-aaa9-289c345615f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:57.501886 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-7cd6db9b-d403-4de2-aaa9-289c345615f2 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:57.503285 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-7cd6db9b-d403-4de2-aaa9-289c345615f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:57.541572 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a62f37-98e8-479e-b107-6758816d9f74 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:57.575681 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2461a21-14f1-4416-a6e5-af44bde892ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:57.576312 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 379/747] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:57 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 30 20:41:57.581473 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2461a21-14f1-4416-a6e5-af44bde892ba None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:57.581766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2461a21-14f1-4416-a6e5-af44bde892ba None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:57.582048 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2461a21-14f1-4416-a6e5-af44bde892ba None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:57.582716 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2461a21-14f1-4416-a6e5-af44bde892ba None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:57.584111 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2461a21-14f1-4416-a6e5-af44bde892ba None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:57.597204 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-a2461a21-14f1-4416-a6e5-af44bde892ba None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 30 20:41:57.597204 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:57.597204 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:41:57.597204 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:41:57.597204 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:41:57.597204 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:41:57.597204 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:41:57.597204 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:41:57.597204 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 30 20:41:57.597204 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:57.597204 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:41:57.597204 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:57.597204 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:57.597204 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:57.597204 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:57.597204 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:57.598767 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:57.598767 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:57.598767 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:57.598767 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:57.598767 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:57.598767 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:57.598767 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:57.598767 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:41:57.598767 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:41:57.598767 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:41:57.598767 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:41:57.598767 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:57.598767 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:57.598767 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:57.598767 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:57.598767 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:57.599694 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:57.599694 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:57.599694 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:57.599694 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:57.599694 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:57.599694 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:57.599694 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:57.599694 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:57.599694 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:57.599694 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:57.599694 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:57.599694 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:41:57.599694 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:41:57.599694 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 30 20:41:57.599694 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:57.600462 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6db9b-d403-4de2-aaa9-289c345615f2 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:57.603738 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 369/748] 10.222.0.26 () {56 vars in 1132 bytes} [Sat Apr 30 20:41:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:57.604872 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2461a21-14f1-4416-a6e5-af44bde892ba None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:57.705419 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6db9b-d403-4de2-aaa9-289c345615f2 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:57.710255 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2461a21-14f1-4416-a6e5-af44bde892ba None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:57.739586 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b6674-9b14-4640-ad04-91268d163351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:57.740504 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b6674-9b14-4640-ad04-91268d163351 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:57.740784 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b6674-9b14-4640-ad04-91268d163351 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:57.741093 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b6674-9b14-4640-ad04-91268d163351 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:57.743540 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436235f-ce6b-4294-b8ce-04efa844738d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:57.744106 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436235f-ce6b-4294-b8ce-04efa844738d None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:57.745048 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436235f-ce6b-4294-b8ce-04efa844738d None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:57.745048 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436235f-ce6b-4294-b8ce-04efa844738d None admin] PATH_INFO: `/v3/services` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:57.745364 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436235f-ce6b-4294-b8ce-04efa844738d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:57.745669 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436235f-ce6b-4294-b8ce-04efa844738d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:57.747102 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436235f-ce6b-4294-b8ce-04efa844738d None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:57.752113 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 370/749] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Apr 30 20:41:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:57.757684 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436235f-ce6b-4294-b8ce-04efa844738d None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:57.809221 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b6674-9b14-4640-ad04-91268d163351 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:57.811052 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b6674-9b14-4640-ad04-91268d163351 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:57.864467 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436235f-ce6b-4294-b8ce-04efa844738d None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:57.898482 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c207709-e71c-4cf8-acdc-24256f2ee5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:57.899137 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c207709-e71c-4cf8-acdc-24256f2ee5f6 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:57.899416 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c207709-e71c-4cf8-acdc-24256f2ee5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:57.899695 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c207709-e71c-4cf8-acdc-24256f2ee5f6 None admin] PATH_INFO: `/v3/services` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:57.900379 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c207709-e71c-4cf8-acdc-24256f2ee5f6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:57.900682 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c207709-e71c-4cf8-acdc-24256f2ee5f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:57.902102 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c207709-e71c-4cf8-acdc-24256f2ee5f6 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:57.906513 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 371/750] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Apr 30 20:41:57 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:41:57.918403 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 380/751] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:41:57 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 30 20:41:57.923881 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c207709-e71c-4cf8-acdc-24256f2ee5f6 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:58.156057 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c207709-e71c-4cf8-acdc-24256f2ee5f6 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:58.190320 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197eb277-1617-42b8-8617-842271afb769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:58.191114 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197eb277-1617-42b8-8617-842271afb769 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:58.191396 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197eb277-1617-42b8-8617-842271afb769 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:58.191670 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197eb277-1617-42b8-8617-842271afb769 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:58.201599 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197eb277-1617-42b8-8617-842271afb769 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:58.203054 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197eb277-1617-42b8-8617-842271afb769 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:58.220208 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-197eb277-1617-42b8-8617-842271afb769 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:58.220208 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:58.220208 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:58.220208 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:58.220208 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:58.220208 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:58.220208 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:58.220208 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:58.220208 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:58.220208 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:58.220208 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:58.220208 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:58.220208 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:41:58.220208 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:41:58.220208 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:41:58.221422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:41:58.221422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:58.221422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:58.221422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:58.221422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:58.221422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:58.221422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:58.221422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:58.221422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:58.221422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:58.221422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:58.221422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:58.221422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:58.221422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:58.221422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:58.221422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:58.221422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:58.222631 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:41:58.222631 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:41:58.222631 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:41:58.222631 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:58.222631 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 372/752] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:41:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:41:58.228013 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b6674-9b14-4640-ad04-91268d163351 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:58.232801 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c5db7-91ef-4c70-b99a-6ec657e0ff22 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:58.233134 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c5db7-91ef-4c70-b99a-6ec657e0ff22 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:58.233415 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c5db7-91ef-4c70-b99a-6ec657e0ff22 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:58.234740 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 373/753] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:41:58.240581 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f988083-9a8e-495d-83b3-64ebdb894e3c None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:58.240871 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f988083-9a8e-495d-83b3-64ebdb894e3c None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:58.241228 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f988083-9a8e-495d-83b3-64ebdb894e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:58.258268 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-9f988083-9a8e-495d-83b3-64ebdb894e3c None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:41:58.259463 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-9f988083-9a8e-495d-83b3-64ebdb894e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:41:58.324943 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 374/754] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:41:58 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 30 20:41:58.332346 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b6674-9b14-4640-ad04-91268d163351 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:58.348573 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f988083-9a8e-495d-83b3-64ebdb894e3c None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:58.367698 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431cac7-1956-43db-8e82-032f0b66ce6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:58.368394 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431cac7-1956-43db-8e82-032f0b66ce6f None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:58.368674 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431cac7-1956-43db-8e82-032f0b66ce6f None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:58.368976 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431cac7-1956-43db-8e82-032f0b66ce6f None admin] PATH_INFO: `/v3/domains` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:58.369694 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431cac7-1956-43db-8e82-032f0b66ce6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:58.370000 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431cac7-1956-43db-8e82-032f0b66ce6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:58.371379 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431cac7-1956-43db-8e82-032f0b66ce6f None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:58.383086 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 381/755] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:41:58.451983 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f988083-9a8e-495d-83b3-64ebdb894e3c None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:58.486937 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b85502-eca8-4846-90c2-1c9efbe22886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:58.487742 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b85502-eca8-4846-90c2-1c9efbe22886 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:58.488018 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b85502-eca8-4846-90c2-1c9efbe22886 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:58.488286 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b85502-eca8-4846-90c2-1c9efbe22886 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:58.488959 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b85502-eca8-4846-90c2-1c9efbe22886 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:58.490326 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b85502-eca8-4846-90c2-1c9efbe22886 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:58.503329 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-40b85502-eca8-4846-90c2-1c9efbe22886 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 30 20:41:58.503329 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:58.503329 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:41:58.503329 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:41:58.503329 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:41:58.503329 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:41:58.503329 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:41:58.503329 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:41:58.503329 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 30 20:41:58.503329 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:58.503329 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:41:58.503329 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:58.503329 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:41:58.503329 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:41:58.503329 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:41:58.503329 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:41:58.503329 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:41:58.504389 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:41:58.504389 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:41:58.504389 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:41:58.504389 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:41:58.504389 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:41:58.504389 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:41:58.504389 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:41:58.504389 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:41:58.504389 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:41:58.504389 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:41:58.504389 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:41:58.504389 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:41:58.504389 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:41:58.504389 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:41:58.504389 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:41:58.504389 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:41:58.505518 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:41:58.505518 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:41:58.505518 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:41:58.505518 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:41:58.505518 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:41:58.505518 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:41:58.505518 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:41:58.505518 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:41:58.505518 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:41:58.505518 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:41:58.505518 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:41:58.505518 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:41:58.505518 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 30 20:41:58.505518 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:41:58.505518 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 375/756] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Apr 30 20:41:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:41:58.514238 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431cac7-1956-43db-8e82-032f0b66ce6f None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:58.615483 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431cac7-1956-43db-8e82-032f0b66ce6f None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:58.648869 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88db0a-ff39-40c1-b29c-d75938194cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:58.649555 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88db0a-ff39-40c1-b29c-d75938194cf3 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:58.649855 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88db0a-ff39-40c1-b29c-d75938194cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:58.650105 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88db0a-ff39-40c1-b29c-d75938194cf3 None admin] PATH_INFO: `/v3/services` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:58.650787 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88db0a-ff39-40c1-b29c-d75938194cf3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:58.651087 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88db0a-ff39-40c1-b29c-d75938194cf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:58.652460 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88db0a-ff39-40c1-b29c-d75938194cf3 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:58.657140 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 382/757] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Apr 30 20:41:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:41:58.662886 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b85502-eca8-4846-90c2-1c9efbe22886 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:41:58.765198 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b85502-eca8-4846-90c2-1c9efbe22886 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:41:58.799842 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1796c9-300a-466d-b3a8-f321aea1941b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:41:58.800507 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1796c9-300a-466d-b3a8-f321aea1941b None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:41:58.800787 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1796c9-300a-466d-b3a8-f321aea1941b None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:41:58.801104 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1796c9-300a-466d-b3a8-f321aea1941b None admin] PATH_INFO: `/v3/services` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:41:58.801802 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1796c9-300a-466d-b3a8-f321aea1941b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:41:58.802106 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1796c9-300a-466d-b3a8-f321aea1941b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:41:58.803497 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1796c9-300a-466d-b3a8-f321aea1941b None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:41:58.807793 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 376/758] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Apr 30 20:41:58 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:42:00.241938 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24b7b5-0bae-4313-873b-cc621a6be235 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:00.242442 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24b7b5-0bae-4313-873b-cc621a6be235 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:00.242442 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24b7b5-0bae-4313-873b-cc621a6be235 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:00.243913 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 383/759] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:42:00.248886 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dc6db-b373-48d9-85e1-749248cf02fd None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:00.249331 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dc6db-b373-48d9-85e1-749248cf02fd None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:00.249485 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dc6db-b373-48d9-85e1-749248cf02fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:00.267150 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-832dc6db-b373-48d9-85e1-749248cf02fd None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:42:00.268596 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-832dc6db-b373-48d9-85e1-749248cf02fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:42:00.333890 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 377/760] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:42:00 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:42:00.357699 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24b7b5-0bae-4313-873b-cc621a6be235 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:00.454322 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24b7b5-0bae-4313-873b-cc621a6be235 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:00.486503 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e6490-e95f-4dd3-9ffe-bcd64f47760d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:00.487160 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e6490-e95f-4dd3-9ffe-bcd64f47760d None admin] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:00.487444 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e6490-e95f-4dd3-9ffe-bcd64f47760d None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:00.487719 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e6490-e95f-4dd3-9ffe-bcd64f47760d None admin] PATH_INFO: `/v3/services` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:00.488441 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e6490-e95f-4dd3-9ffe-bcd64f47760d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:00.489851 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e6490-e95f-4dd3-9ffe-bcd64f47760d None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:00.546416 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 384/761] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Apr 30 20:42:00 2022] POST /identity/v3/services => generated 269 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 20:42:01.099513 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eef082-c0f8-4bd3-98c5-b51ce767b20e None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:01.099735 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eef082-c0f8-4bd3-98c5-b51ce767b20e None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:01.100001 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eef082-c0f8-4bd3-98c5-b51ce767b20e None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:01.101641 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 378/762] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:42:01.106909 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd743da5-ec8a-4765-be23-6eff09429582 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:01.107206 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd743da5-ec8a-4765-be23-6eff09429582 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:01.107484 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd743da5-ec8a-4765-be23-6eff09429582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:01.124604 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-fd743da5-ec8a-4765-be23-6eff09429582 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:42:01.127933 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-fd743da5-ec8a-4765-be23-6eff09429582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:42:01.196058 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 385/763] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:42:01 2022] POST /identity/v3/auth/tokens => generated 1506 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:42:01.219312 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eef082-c0f8-4bd3-98c5-b51ce767b20e None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:01.320789 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eef082-c0f8-4bd3-98c5-b51ce767b20e None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:01.353634 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cd13b-b64f-4e33-9aa9-7a7d0100a24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:01.354222 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cd13b-b64f-4e33-9aa9-7a7d0100a24a None admin] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:01.354561 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cd13b-b64f-4e33-9aa9-7a7d0100a24a None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:01.354840 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cd13b-b64f-4e33-9aa9-7a7d0100a24a None admin] PATH_INFO: `/v3/services` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:01.355560 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7cd13b-b64f-4e33-9aa9-7a7d0100a24a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:01.356992 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7cd13b-b64f-4e33-9aa9-7a7d0100a24a None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:01.480274 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 379/764] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Apr 30 20:42:01 2022] POST /identity/v3/services => generated 251 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:42:02.844651 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ebfba-081c-482a-a098-e94b2ac67bd7 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:02.845286 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ebfba-081c-482a-a098-e94b2ac67bd7 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:02.845286 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ebfba-081c-482a-a098-e94b2ac67bd7 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:02.846792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 386/765] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:42:02.852217 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df0794-4a7d-4af7-9f05-66320ce3cc40 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:02.852614 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df0794-4a7d-4af7-9f05-66320ce3cc40 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:02.852774 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df0794-4a7d-4af7-9f05-66320ce3cc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:02.869576 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-57df0794-4a7d-4af7-9f05-66320ce3cc40 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:42:02.870743 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-57df0794-4a7d-4af7-9f05-66320ce3cc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:42:02.939238 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 380/766] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:42:02 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:42:02.962594 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ebfba-081c-482a-a098-e94b2ac67bd7 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:03.061893 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ebfba-081c-482a-a098-e94b2ac67bd7 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:03.095497 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081bf76-fd9d-4a3d-bbe1-35f5dfa87641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:03.096323 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081bf76-fd9d-4a3d-bbe1-35f5dfa87641 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:03.096606 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081bf76-fd9d-4a3d-bbe1-35f5dfa87641 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:03.096878 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081bf76-fd9d-4a3d-bbe1-35f5dfa87641 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:03.097557 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8081bf76-fd9d-4a3d-bbe1-35f5dfa87641 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:03.098941 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8081bf76-fd9d-4a3d-bbe1-35f5dfa87641 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:03.111667 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-8081bf76-fd9d-4a3d-bbe1-35f5dfa87641 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 30 20:42:03.111667 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:42:03.111667 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:42:03.111667 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:42:03.111667 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:42:03.111667 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:42:03.111667 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:42:03.111667 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:42:03.111667 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 30 20:42:03.111667 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:42:03.111667 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:42:03.111667 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:42:03.111667 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:42:03.111667 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:42:03.111667 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:42:03.111667 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:42:03.112727 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:42:03.112727 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:42:03.112727 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:42:03.112727 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:42:03.112727 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:42:03.112727 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:42:03.112727 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:42:03.112727 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:42:03.112727 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:42:03.112727 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:42:03.112727 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:42:03.112727 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:42:03.112727 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:42:03.112727 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:42:03.112727 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:42:03.112727 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:42:03.113779 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:42:03.113779 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:42:03.113779 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:42:03.113779 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:42:03.113779 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:42:03.113779 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:42:03.113779 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:42:03.113779 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:42:03.113779 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:42:03.113779 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:42:03.113779 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:42:03.113779 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:42:03.113779 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:42:03.113779 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 30 20:42:03.113779 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:42:03.113779 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 387/767] 10.222.0.26 () {56 vars in 1132 bytes} [Sat Apr 30 20:42:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:42:03.118881 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df0794-4a7d-4af7-9f05-66320ce3cc40 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:03.212846 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df0794-4a7d-4af7-9f05-66320ce3cc40 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:03.245501 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c11c1-7a65-4e50-b113-9b5147ab7c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:03.246154 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c11c1-7a65-4e50-b113-9b5147ab7c34 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:03.246433 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c11c1-7a65-4e50-b113-9b5147ab7c34 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:03.246703 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c11c1-7a65-4e50-b113-9b5147ab7c34 None admin] PATH_INFO: `/v3/services` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:03.247464 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c11c1-7a65-4e50-b113-9b5147ab7c34 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:42:03.247941 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c11c1-7a65-4e50-b113-9b5147ab7c34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:03.249774 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c11c1-7a65-4e50-b113-9b5147ab7c34 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:03.254199 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 381/768] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Apr 30 20:42:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:42:03.259888 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081bf76-fd9d-4a3d-bbe1-35f5dfa87641 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:03.361291 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081bf76-fd9d-4a3d-bbe1-35f5dfa87641 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:03.395784 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef322b-a70f-4b3c-aa44-ae8fce81bf71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:03.396446 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef322b-a70f-4b3c-aa44-ae8fce81bf71 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:03.396723 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef322b-a70f-4b3c-aa44-ae8fce81bf71 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:03.397028 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef322b-a70f-4b3c-aa44-ae8fce81bf71 None admin] PATH_INFO: `/v3/services` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:03.397726 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef322b-a70f-4b3c-aa44-ae8fce81bf71 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:42:03.398028 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef322b-a70f-4b3c-aa44-ae8fce81bf71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:03.399400 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef322b-a70f-4b3c-aa44-ae8fce81bf71 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:03.404283 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 388/769] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Apr 30 20:42:03 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:42:03.410714 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c11c1-7a65-4e50-b113-9b5147ab7c34 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:03.508701 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c11c1-7a65-4e50-b113-9b5147ab7c34 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:03.545100 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddfe87-8619-4afb-bed5-0d4c96dd6237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:03.545820 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddfe87-8619-4afb-bed5-0d4c96dd6237 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:03.546225 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddfe87-8619-4afb-bed5-0d4c96dd6237 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:03.546541 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddfe87-8619-4afb-bed5-0d4c96dd6237 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:03.547323 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddfe87-8619-4afb-bed5-0d4c96dd6237 None admin] RBAC: Adding query filter params (interface=public, service_id=fa3e95e7627b4047a175dc0bd6c4947c, region_id=RegionOne) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:42:03.547669 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddfe87-8619-4afb-bed5-0d4c96dd6237 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:03.549198 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddfe87-8619-4afb-bed5-0d4c96dd6237 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:03.554559 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 382/770] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Apr 30 20:42:03 2022] GET /identity/v3/endpoints?service_id=fa3e95e7627b4047a175dc0bd6c4947c&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:42:03.559975 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef322b-a70f-4b3c-aa44-ae8fce81bf71 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:03.664055 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef322b-a70f-4b3c-aa44-ae8fce81bf71 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:03.697666 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022fe25-2b8c-4460-ac6e-ccfc628ee44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:03.698327 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022fe25-2b8c-4460-ac6e-ccfc628ee44c None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:03.698609 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022fe25-2b8c-4460-ac6e-ccfc628ee44c None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:03.698883 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022fe25-2b8c-4460-ac6e-ccfc628ee44c None admin] PATH_INFO: `/v3/services` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:03.699555 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022fe25-2b8c-4460-ac6e-ccfc628ee44c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:03.700971 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022fe25-2b8c-4460-ac6e-ccfc628ee44c None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:03.716934 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 389/771] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Apr 30 20:42:03 2022] GET /identity/v3/services => generated 1498 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 20:42:03.833187 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94720c-0235-489f-bdba-df2cbc0890f3 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:03.833478 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94720c-0235-489f-bdba-df2cbc0890f3 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:03.833759 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94720c-0235-489f-bdba-df2cbc0890f3 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:03.835126 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 383/772] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:42:03.840953 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a1954-4a5e-4e0b-96b8-c3b82ac36849 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:03.841246 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a1954-4a5e-4e0b-96b8-c3b82ac36849 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:03.841526 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a1954-4a5e-4e0b-96b8-c3b82ac36849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:03.860788 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-5d2a1954-4a5e-4e0b-96b8-c3b82ac36849 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:42:03.862447 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-5d2a1954-4a5e-4e0b-96b8-c3b82ac36849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:42:03.931272 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 390/773] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:42:03 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:42:03.954414 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94720c-0235-489f-bdba-df2cbc0890f3 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:04.055005 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94720c-0235-489f-bdba-df2cbc0890f3 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:04.087805 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163b9eb-d84e-44dd-94a4-b6ccdfc129d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:04.088594 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163b9eb-d84e-44dd-94a4-b6ccdfc129d9 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:04.088875 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163b9eb-d84e-44dd-94a4-b6ccdfc129d9 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:04.089178 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163b9eb-d84e-44dd-94a4-b6ccdfc129d9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:04.089824 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3163b9eb-d84e-44dd-94a4-b6ccdfc129d9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:04.091189 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3163b9eb-d84e-44dd-94a4-b6ccdfc129d9 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:04.103680 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-3163b9eb-d84e-44dd-94a4-b6ccdfc129d9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 30 20:42:04.103680 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:42:04.103680 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:42:04.103680 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:42:04.103680 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:42:04.103680 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:42:04.103680 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:42:04.103680 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:42:04.103680 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 30 20:42:04.103680 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:42:04.103680 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:42:04.103680 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:42:04.103680 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:42:04.103680 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:42:04.103680 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:42:04.103680 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:42:04.103680 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:42:04.104672 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:42:04.104672 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:42:04.104672 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:42:04.104672 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:42:04.104672 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:42:04.104672 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:42:04.104672 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:42:04.104672 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:42:04.104672 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:42:04.104672 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:42:04.104672 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:42:04.104672 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:42:04.104672 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:42:04.104672 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:42:04.104672 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:42:04.104672 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:42:04.106058 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:42:04.106058 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:42:04.106058 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:42:04.106058 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:42:04.106058 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:42:04.106058 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:42:04.106058 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:42:04.106058 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:42:04.106058 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:42:04.106058 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:42:04.106058 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:42:04.106058 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:42:04.106058 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 30 20:42:04.106058 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:42:04.106058 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 384/774] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Apr 30 20:42:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:42:04.110819 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a1954-4a5e-4e0b-96b8-c3b82ac36849 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:04.203561 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a1954-4a5e-4e0b-96b8-c3b82ac36849 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:04.236594 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8e5fa-5bf3-424e-ab7e-546bb356db3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:04.237289 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8e5fa-5bf3-424e-ab7e-546bb356db3e None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:04.237570 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8e5fa-5bf3-424e-ab7e-546bb356db3e None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:04.237843 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8e5fa-5bf3-424e-ab7e-546bb356db3e None admin] PATH_INFO: `/v3/services` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:04.238532 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de8e5fa-5bf3-424e-ab7e-546bb356db3e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:42:04.238837 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de8e5fa-5bf3-424e-ab7e-546bb356db3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:04.240207 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de8e5fa-5bf3-424e-ab7e-546bb356db3e None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:04.244679 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 391/775] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Apr 30 20:42:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:42:04.250355 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163b9eb-d84e-44dd-94a4-b6ccdfc129d9 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:04.346861 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163b9eb-d84e-44dd-94a4-b6ccdfc129d9 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:04.379207 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ed90d-6d38-4756-a436-88ae65863293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:04.379861 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ed90d-6d38-4756-a436-88ae65863293 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:04.380145 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ed90d-6d38-4756-a436-88ae65863293 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:04.380422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ed90d-6d38-4756-a436-88ae65863293 None admin] PATH_INFO: `/v3/services` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:04.381151 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ed90d-6d38-4756-a436-88ae65863293 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:42:04.381462 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ed90d-6d38-4756-a436-88ae65863293 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:04.382822 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ed90d-6d38-4756-a436-88ae65863293 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:04.387443 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 385/776] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Apr 30 20:42:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:42:04.393475 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8e5fa-5bf3-424e-ab7e-546bb356db3e None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:04.490053 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8e5fa-5bf3-424e-ab7e-546bb356db3e None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:04.522898 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0e91f-d663-4a51-a2dd-906c004ab5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:04.523556 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0e91f-d663-4a51-a2dd-906c004ab5ee None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:04.523842 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0e91f-d663-4a51-a2dd-906c004ab5ee None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:04.524121 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0e91f-d663-4a51-a2dd-906c004ab5ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:04.524922 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf0e91f-d663-4a51-a2dd-906c004ab5ee None admin] RBAC: Adding query filter params (interface=public, service_id=3407005bfe804998982229ffefb2c213, region_id=RegionOne) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:42:04.525247 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf0e91f-d663-4a51-a2dd-906c004ab5ee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:04.526655 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf0e91f-d663-4a51-a2dd-906c004ab5ee None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:04.531651 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 392/777] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Apr 30 20:42:04 2022] GET /identity/v3/endpoints?service_id=3407005bfe804998982229ffefb2c213&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:42:04.537888 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ed90d-6d38-4756-a436-88ae65863293 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:04.634941 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ed90d-6d38-4756-a436-88ae65863293 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:04.667761 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d2fc6-389e-4d84-9658-121133598cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:04.668423 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d2fc6-389e-4d84-9658-121133598cc7 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:04.668707 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d2fc6-389e-4d84-9658-121133598cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:04.669006 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d2fc6-389e-4d84-9658-121133598cc7 None admin] PATH_INFO: `/v3/services` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:04.669680 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d2fc6-389e-4d84-9658-121133598cc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:04.671050 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d2fc6-389e-4d84-9658-121133598cc7 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:04.677496 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 386/778] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Apr 30 20:42:04 2022] GET /identity/v3/services => generated 1498 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 20:42:06.002670 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c3668-c724-4632-a5da-a5b8e582aefb None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:06.003190 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c3668-c724-4632-a5da-a5b8e582aefb None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:06.003300 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c3668-c724-4632-a5da-a5b8e582aefb None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:06.004569 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 393/779] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:42:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:42:06.009918 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116496c0-aed6-47d3-b465-a30a79a0a5c9 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:06.010345 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116496c0-aed6-47d3-b465-a30a79a0a5c9 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:06.010592 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116496c0-aed6-47d3-b465-a30a79a0a5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:06.026896 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-116496c0-aed6-47d3-b465-a30a79a0a5c9 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:42:06.028058 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-116496c0-aed6-47d3-b465-a30a79a0a5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:42:06.090194 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 387/780] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:42:06 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:42:06.114405 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c3668-c724-4632-a5da-a5b8e582aefb None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:06.209584 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c3668-c724-4632-a5da-a5b8e582aefb None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:06.241695 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4b573-bdfe-469a-8ccd-10c2171af570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:06.242491 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4b573-bdfe-469a-8ccd-10c2171af570 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:06.242767 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4b573-bdfe-469a-8ccd-10c2171af570 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:06.243036 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4b573-bdfe-469a-8ccd-10c2171af570 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:06.243663 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4b573-bdfe-469a-8ccd-10c2171af570 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:06.245183 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4b573-bdfe-469a-8ccd-10c2171af570 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:06.257596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-57c4b573-bdfe-469a-8ccd-10c2171af570 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 30 20:42:06.257596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:42:06.257596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:42:06.257596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:42:06.257596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:42:06.257596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:42:06.257596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:42:06.257596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:42:06.257596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 30 20:42:06.257596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:42:06.257596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:42:06.257596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:42:06.257596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:42:06.257596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:42:06.257596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:42:06.257596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:42:06.258697 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:42:06.258697 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:42:06.258697 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:42:06.258697 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:42:06.258697 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:42:06.258697 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:42:06.258697 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:42:06.258697 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:42:06.258697 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:42:06.258697 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:42:06.258697 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:42:06.258697 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:42:06.258697 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:42:06.258697 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:42:06.258697 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:42:06.258697 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:42:06.259724 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:42:06.259724 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:42:06.259724 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:42:06.259724 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:42:06.259724 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:42:06.259724 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:42:06.259724 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:42:06.259724 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:42:06.259724 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:42:06.259724 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:42:06.259724 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:42:06.259724 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:42:06.259724 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:42:06.259724 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 30 20:42:06.259724 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:42:06.261054 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 394/781] 10.222.0.26 () {56 vars in 1132 bytes} [Sat Apr 30 20:42:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:42:06.264619 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116496c0-aed6-47d3-b465-a30a79a0a5c9 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:06.357842 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116496c0-aed6-47d3-b465-a30a79a0a5c9 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:06.389893 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25dfd7-5eed-45a9-9355-766a400d968c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:06.390550 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25dfd7-5eed-45a9-9355-766a400d968c None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:06.390827 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25dfd7-5eed-45a9-9355-766a400d968c None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:06.391095 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25dfd7-5eed-45a9-9355-766a400d968c None admin] PATH_INFO: `/v3/services` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:06.391843 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25dfd7-5eed-45a9-9355-766a400d968c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:42:06.392146 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25dfd7-5eed-45a9-9355-766a400d968c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:06.393527 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25dfd7-5eed-45a9-9355-766a400d968c None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:06.397980 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 388/782] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Apr 30 20:42:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:42:06.403553 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4b573-bdfe-469a-8ccd-10c2171af570 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:06.500121 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4b573-bdfe-469a-8ccd-10c2171af570 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:06.533360 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce69b3-ba72-468a-ac10-e5061ddb53b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:06.534025 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce69b3-ba72-468a-ac10-e5061ddb53b0 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:06.534307 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce69b3-ba72-468a-ac10-e5061ddb53b0 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:06.534587 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce69b3-ba72-468a-ac10-e5061ddb53b0 None admin] PATH_INFO: `/v3/services` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:06.535281 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce69b3-ba72-468a-ac10-e5061ddb53b0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:42:06.535586 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce69b3-ba72-468a-ac10-e5061ddb53b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:06.536991 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce69b3-ba72-468a-ac10-e5061ddb53b0 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:06.541709 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 395/783] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Apr 30 20:42:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:42:06.547228 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25dfd7-5eed-45a9-9355-766a400d968c None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:06.641011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25dfd7-5eed-45a9-9355-766a400d968c None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:06.672990 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce967cbd-a737-489c-8680-f82182afba93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:06.673765 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce967cbd-a737-489c-8680-f82182afba93 None admin] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:06.674048 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce967cbd-a737-489c-8680-f82182afba93 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:06.674323 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce967cbd-a737-489c-8680-f82182afba93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:06.675064 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce967cbd-a737-489c-8680-f82182afba93 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:06.676417 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce967cbd-a737-489c-8680-f82182afba93 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:06.736540 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 389/784] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Apr 30 20:42:06 2022] POST /identity/v3/endpoints => generated 347 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 20:42:06.987410 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091532eb-5cfd-4767-b5b1-81e1725a1b7c None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:06.987625 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091532eb-5cfd-4767-b5b1-81e1725a1b7c None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:06.987902 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091532eb-5cfd-4767-b5b1-81e1725a1b7c None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:06.989332 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 396/785] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:42:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:42:06.994546 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10c44e-ac69-4cd2-9c34-2aa856628bd6 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:06.994841 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10c44e-ac69-4cd2-9c34-2aa856628bd6 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:06.995119 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10c44e-ac69-4cd2-9c34-2aa856628bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:07.011283 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-fa10c44e-ac69-4cd2-9c34-2aa856628bd6 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:42:07.012455 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-fa10c44e-ac69-4cd2-9c34-2aa856628bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:42:07.081594 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 390/786] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:42:06 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:42:07.104966 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091532eb-5cfd-4767-b5b1-81e1725a1b7c None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:07.203750 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091532eb-5cfd-4767-b5b1-81e1725a1b7c None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:07.235604 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6a370-e001-4a74-9154-a375b2a00ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:07.236527 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6a370-e001-4a74-9154-a375b2a00ce3 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:07.236805 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6a370-e001-4a74-9154-a375b2a00ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:07.237111 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6a370-e001-4a74-9154-a375b2a00ce3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:07.237799 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6a370-e001-4a74-9154-a375b2a00ce3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:07.239134 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6a370-e001-4a74-9154-a375b2a00ce3 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:07.250484 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-56f6a370-e001-4a74-9154-a375b2a00ce3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 30 20:42:07.250484 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:42:07.250484 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:42:07.250484 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:42:07.250484 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:42:07.250484 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:42:07.250484 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:42:07.250484 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:42:07.250484 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 30 20:42:07.250484 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:42:07.250484 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:42:07.250484 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:42:07.250484 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:42:07.250484 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:42:07.250484 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:42:07.250484 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:42:07.250484 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:42:07.251713 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:42:07.251713 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:42:07.251713 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:42:07.251713 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:42:07.251713 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:42:07.251713 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:42:07.251713 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:42:07.251713 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:42:07.251713 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:42:07.251713 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:42:07.251713 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:42:07.251713 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:42:07.251713 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:42:07.251713 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:42:07.251713 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:42:07.251713 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:42:07.252633 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:42:07.252633 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:42:07.252633 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:42:07.252633 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:42:07.252633 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:42:07.252633 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:42:07.252633 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:42:07.252633 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:42:07.252633 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:42:07.252633 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:42:07.252633 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:42:07.252633 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:42:07.252633 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 30 20:42:07.252633 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:42:07.256969 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 397/787] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Apr 30 20:42:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:42:07.257833 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10c44e-ac69-4cd2-9c34-2aa856628bd6 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:07.351849 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10c44e-ac69-4cd2-9c34-2aa856628bd6 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:07.383848 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d14ad-e894-44db-bd34-d72fbe259843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:07.384498 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d14ad-e894-44db-bd34-d72fbe259843 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:07.384781 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d14ad-e894-44db-bd34-d72fbe259843 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:07.385093 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d14ad-e894-44db-bd34-d72fbe259843 None admin] PATH_INFO: `/v3/services` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:07.385785 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d14ad-e894-44db-bd34-d72fbe259843 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:42:07.386092 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d14ad-e894-44db-bd34-d72fbe259843 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:07.387454 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d14ad-e894-44db-bd34-d72fbe259843 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:07.392657 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 391/788] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Apr 30 20:42:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:42:07.398288 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6a370-e001-4a74-9154-a375b2a00ce3 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:07.494775 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6a370-e001-4a74-9154-a375b2a00ce3 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:07.527752 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1359d2-14d6-49e6-88ae-77354363e731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:07.528418 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1359d2-14d6-49e6-88ae-77354363e731 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:07.528698 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1359d2-14d6-49e6-88ae-77354363e731 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:07.529007 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1359d2-14d6-49e6-88ae-77354363e731 None admin] PATH_INFO: `/v3/services` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:07.529700 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1359d2-14d6-49e6-88ae-77354363e731 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:42:07.530005 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1359d2-14d6-49e6-88ae-77354363e731 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:07.531383 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1359d2-14d6-49e6-88ae-77354363e731 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:07.536436 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 398/789] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Apr 30 20:42:07 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:42:07.541979 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d14ad-e894-44db-bd34-d72fbe259843 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:07.638683 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d14ad-e894-44db-bd34-d72fbe259843 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:07.672038 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289090d5-e57d-4591-8296-96d6dec46c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:07.672695 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289090d5-e57d-4591-8296-96d6dec46c27 None admin] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:07.673000 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289090d5-e57d-4591-8296-96d6dec46c27 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:07.674982 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289090d5-e57d-4591-8296-96d6dec46c27 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:07.674982 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289090d5-e57d-4591-8296-96d6dec46c27 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:07.675498 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289090d5-e57d-4591-8296-96d6dec46c27 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:07.804200 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 392/790] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Apr 30 20:42:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:42:09.048636 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e19de-54cd-4b61-ad0d-cdc96b67ab2a None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:09.049207 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e19de-54cd-4b61-ad0d-cdc96b67ab2a None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:09.049207 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e19de-54cd-4b61-ad0d-cdc96b67ab2a None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:09.050568 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 399/791] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:42:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:42:09.055794 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d1362-7ae1-4f00-b98b-e83cd1cf3340 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:09.056225 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d1362-7ae1-4f00-b98b-e83cd1cf3340 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:09.056345 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d1362-7ae1-4f00-b98b-e83cd1cf3340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:09.072723 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-d48d1362-7ae1-4f00-b98b-e83cd1cf3340 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:42:09.073982 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-d48d1362-7ae1-4f00-b98b-e83cd1cf3340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:42:09.141061 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 393/792] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:42:09 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:42:09.164360 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e19de-54cd-4b61-ad0d-cdc96b67ab2a None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:09.263697 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e19de-54cd-4b61-ad0d-cdc96b67ab2a None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:09.296652 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588abe96-a18e-4082-b6c1-6819eab6445e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:09.297519 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588abe96-a18e-4082-b6c1-6819eab6445e None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:09.297844 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588abe96-a18e-4082-b6c1-6819eab6445e None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:09.298121 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588abe96-a18e-4082-b6c1-6819eab6445e None admin] PATH_INFO: `/v3/services/compute` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:09.298765 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588abe96-a18e-4082-b6c1-6819eab6445e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:09.300139 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588abe96-a18e-4082-b6c1-6819eab6445e None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:09.311485 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-588abe96-a18e-4082-b6c1-6819eab6445e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 30 20:42:09.311485 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:42:09.311485 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:42:09.311485 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:42:09.311485 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:42:09.311485 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:42:09.311485 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:42:09.311485 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:42:09.311485 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Apr 30 20:42:09.311485 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:42:09.311485 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:42:09.311485 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:42:09.311485 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:42:09.311485 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:42:09.311485 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:42:09.311485 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:42:09.311485 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:42:09.312553 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:42:09.312553 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:42:09.312553 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:42:09.312553 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:42:09.312553 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:42:09.312553 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:42:09.312553 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:42:09.312553 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:42:09.312553 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:42:09.312553 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:42:09.312553 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:42:09.312553 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:42:09.312553 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:42:09.312553 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:42:09.312553 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:42:09.312553 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:42:09.313637 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:42:09.313637 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:42:09.313637 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:42:09.313637 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:42:09.313637 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:42:09.313637 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:42:09.313637 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:42:09.313637 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:42:09.313637 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:42:09.313637 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:42:09.313637 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:42:09.313637 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:42:09.313637 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Apr 30 20:42:09.313637 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:42:09.313637 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 400/793] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:42:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:42:09.318688 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d1362-7ae1-4f00-b98b-e83cd1cf3340 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:09.414251 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d1362-7ae1-4f00-b98b-e83cd1cf3340 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:09.445811 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9bc072-104c-4302-8eb8-a265b0628560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:09.446467 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bc072-104c-4302-8eb8-a265b0628560 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:09.446750 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bc072-104c-4302-8eb8-a265b0628560 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:09.447027 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bc072-104c-4302-8eb8-a265b0628560 None admin] PATH_INFO: `/v3/services` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:09.447723 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9bc072-104c-4302-8eb8-a265b0628560 None admin] RBAC: Adding query filter params (name=compute) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:42:09.448031 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9bc072-104c-4302-8eb8-a265b0628560 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:09.449437 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9bc072-104c-4302-8eb8-a265b0628560 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:09.454505 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 394/794] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Apr 30 20:42:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:42:09.460081 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588abe96-a18e-4082-b6c1-6819eab6445e None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:09.556708 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588abe96-a18e-4082-b6c1-6819eab6445e None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:09.589843 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0476434-99f9-446d-bb9f-0884e17a6102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:09.590515 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0476434-99f9-446d-bb9f-0884e17a6102 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:09.590800 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0476434-99f9-446d-bb9f-0884e17a6102 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:09.591078 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0476434-99f9-446d-bb9f-0884e17a6102 None admin] PATH_INFO: `/v3/services` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:09.591776 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0476434-99f9-446d-bb9f-0884e17a6102 None admin] RBAC: Adding query filter params (type=compute) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:42:09.592085 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0476434-99f9-446d-bb9f-0884e17a6102 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:09.593498 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0476434-99f9-446d-bb9f-0884e17a6102 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:09.598580 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 401/795] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Apr 30 20:42:09 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:42:10.119549 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d591dc0-b665-4bce-ad98-157a9eebef3c None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:10.120058 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d591dc0-b665-4bce-ad98-157a9eebef3c None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:10.120058 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d591dc0-b665-4bce-ad98-157a9eebef3c None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:10.121378 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 395/796] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:42:10.126662 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecb7bc-3e9b-4a6c-8cbd-eb9db16934db None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:10.127039 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecb7bc-3e9b-4a6c-8cbd-eb9db16934db None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:10.127219 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecb7bc-3e9b-4a6c-8cbd-eb9db16934db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:10.143807 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-67ecb7bc-3e9b-4a6c-8cbd-eb9db16934db None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:42:10.144983 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-67ecb7bc-3e9b-4a6c-8cbd-eb9db16934db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:42:10.207315 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 402/797] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:42:10 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:42:10.231713 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d591dc0-b665-4bce-ad98-157a9eebef3c None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:10.330094 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d591dc0-b665-4bce-ad98-157a9eebef3c None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:10.363123 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0b1bf-8579-4c7e-94ca-97c4dfacf3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:10.363776 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0b1bf-8579-4c7e-94ca-97c4dfacf3bb None admin] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:10.364057 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0b1bf-8579-4c7e-94ca-97c4dfacf3bb None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:10.364329 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0b1bf-8579-4c7e-94ca-97c4dfacf3bb None admin] PATH_INFO: `/v3/projects` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:10.365070 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd0b1bf-8579-4c7e-94ca-97c4dfacf3bb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:10.366486 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd0b1bf-8579-4c7e-94ca-97c4dfacf3bb None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:10.367887 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: WARNING keystone.server.flask.common [None req-ddd0b1bf-8579-4c7e-94ca-97c4dfacf3bb None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 30 20:42:10.410625 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.sql.core [None req-ddd0b1bf-8579-4c7e-94ca-97c4dfacf3bb None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Apr 30 20:42:10.410625 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 30 20:42:10.410625 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [parameters: {'id': '5ed505637bef4904a43da6598ada613d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Apr 30 20:42:10.410625 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=98588) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 30 20:42:10.426996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-ddd0b1bf-8579-4c7e-94ca-97c4dfacf3bb None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5ed505637bef4904a43da6598ada613d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5ed505637bef4904a43da6598ada613d. Apr 30 20:42:10.426996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:42:10.426996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Apr 30 20:42:10.426996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application self.dialect.do_execute( Apr 30 20:42:10.426996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Apr 30 20:42:10.426996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Apr 30 20:42:10.426996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Apr 30 20:42:10.426996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application result = self._query(query) Apr 30 20:42:10.426996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Apr 30 20:42:10.426996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application conn.query(q) Apr 30 20:42:10.426996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Apr 30 20:42:10.426996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Apr 30 20:42:10.426996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Apr 30 20:42:10.427964 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application result.read() Apr 30 20:42:10.427964 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Apr 30 20:42:10.427964 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Apr 30 20:42:10.427964 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Apr 30 20:42:10.427964 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application packet.raise_for_error() Apr 30 20:42:10.427964 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Apr 30 20:42:10.427964 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Apr 30 20:42:10.427964 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Apr 30 20:42:10.427964 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Apr 30 20:42:10.427964 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Apr 30 20:42:10.427964 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:42:10.427964 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Apr 30 20:42:10.427964 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:42:10.427964 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:42:10.427964 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Apr 30 20:42:10.427964 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return method(*args, **kwargs) Apr 30 20:42:10.427964 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Apr 30 20:42:10.427964 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return project_ref.to_dict() Apr 30 20:42:10.428973 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Apr 30 20:42:10.428973 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application next(self.gen) Apr 30 20:42:10.428973 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Apr 30 20:42:10.428973 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application yield resource Apr 30 20:42:10.428973 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Apr 30 20:42:10.428973 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application next(self.gen) Apr 30 20:42:10.428973 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Apr 30 20:42:10.428973 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application self.session.rollback() Apr 30 20:42:10.428973 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Apr 30 20:42:10.428973 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application self.force_reraise() Apr 30 20:42:10.428973 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Apr 30 20:42:10.428973 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise self.value Apr 30 20:42:10.428973 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Apr 30 20:42:10.428973 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Apr 30 20:42:10.428973 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Apr 30 20:42:10.428973 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application session.commit() Apr 30 20:42:10.428973 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1431, in commit Apr 30 20:42:10.429890 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Apr 30 20:42:10.429890 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Apr 30 20:42:10.429890 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application self._prepare_impl() Apr 30 20:42:10.429890 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Apr 30 20:42:10.429890 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application self.session.flush() Apr 30 20:42:10.429890 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3363, in flush Apr 30 20:42:10.429890 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application self._flush(objects) Apr 30 20:42:10.429890 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3503, in _flush Apr 30 20:42:10.429890 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Apr 30 20:42:10.429890 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Apr 30 20:42:10.429890 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application compat.raise_( Apr 30 20:42:10.429890 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Apr 30 20:42:10.429890 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception Apr 30 20:42:10.429890 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3463, in _flush Apr 30 20:42:10.429890 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application flush_context.execute() Apr 30 20:42:10.429890 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Apr 30 20:42:10.429890 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rec.execute(self) Apr 30 20:42:10.430794 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Apr 30 20:42:10.430794 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Apr 30 20:42:10.430794 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Apr 30 20:42:10.430794 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application _emit_insert_statements( Apr 30 20:42:10.430794 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Apr 30 20:42:10.430794 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application c = connection._execute_20( Apr 30 20:42:10.430794 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Apr 30 20:42:10.430794 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Apr 30 20:42:10.430794 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Apr 30 20:42:10.430794 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Apr 30 20:42:10.430794 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Apr 30 20:42:10.430794 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ret = self._execute_context( Apr 30 20:42:10.430794 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Apr 30 20:42:10.430794 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Apr 30 20:42:10.430794 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Apr 30 20:42:10.431592 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Apr 30 20:42:10.431592 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Apr 30 20:42:10.431592 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception Apr 30 20:42:10.431592 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Apr 30 20:42:10.431592 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application self.dialect.do_execute( Apr 30 20:42:10.431592 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Apr 30 20:42:10.431592 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Apr 30 20:42:10.431592 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Apr 30 20:42:10.431592 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application result = self._query(query) Apr 30 20:42:10.431592 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Apr 30 20:42:10.431592 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application conn.query(q) Apr 30 20:42:10.431592 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Apr 30 20:42:10.431592 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Apr 30 20:42:10.431592 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Apr 30 20:42:10.431592 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application result.read() Apr 30 20:42:10.431592 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Apr 30 20:42:10.431592 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Apr 30 20:42:10.432553 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Apr 30 20:42:10.432553 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application packet.raise_for_error() Apr 30 20:42:10.432553 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Apr 30 20:42:10.432553 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Apr 30 20:42:10.432553 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Apr 30 20:42:10.432553 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Apr 30 20:42:10.432553 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Apr 30 20:42:10.432553 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 30 20:42:10.432553 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [parameters: {'id': '5ed505637bef4904a43da6598ada613d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Apr 30 20:42:10.432553 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Apr 30 20:42:10.432553 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:42:10.432553 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:42:10.432553 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:42:10.432553 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:42:10.432553 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Apr 30 20:42:10.433364 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Apr 30 20:42:10.433364 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Apr 30 20:42:10.433364 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Apr 30 20:42:10.433364 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Apr 30 20:42:10.433364 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:42:10.433364 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:42:10.433364 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:42:10.433364 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:42:10.433364 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:42:10.433364 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:42:10.433364 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:42:10.433364 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:42:10.433364 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:42:10.433364 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:42:10.433364 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:42:10.433364 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:42:10.433364 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:42:10.434252 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:42:10.434252 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Apr 30 20:42:10.434252 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Apr 30 20:42:10.434252 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:42:10.434252 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:42:10.434252 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Apr 30 20:42:10.434252 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.Conflict( Apr 30 20:42:10.434252 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5ed505637bef4904a43da6598ada613d. Apr 30 20:42:10.434252 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:42:10.434252 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 396/798] 10.222.0.26 () {60 vars in 1140 bytes} [Sat Apr 30 20:42:10 2022] POST /identity/v3/projects => generated 262 bytes in 197 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:42:10.434785 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecb7bc-3e9b-4a6c-8cbd-eb9db16934db None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:10.528928 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecb7bc-3e9b-4a6c-8cbd-eb9db16934db None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:10.561270 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f29078-2796-474a-b35f-e1538a0ede8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:10.562055 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f29078-2796-474a-b35f-e1538a0ede8a None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:10.562338 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f29078-2796-474a-b35f-e1538a0ede8a None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:10.562614 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f29078-2796-474a-b35f-e1538a0ede8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:10.570283 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f29078-2796-474a-b35f-e1538a0ede8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:10.571733 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f29078-2796-474a-b35f-e1538a0ede8a None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:10.585730 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-c8f29078-2796-474a-b35f-e1538a0ede8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:42:10.585730 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:42:10.585730 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:42:10.585730 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:42:10.585730 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:42:10.585730 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:42:10.585730 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:42:10.585730 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:42:10.585730 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:42:10.585730 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:42:10.585730 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:42:10.585730 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:42:10.585730 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:42:10.585730 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:42:10.585730 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:42:10.586636 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:42:10.586636 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:42:10.586636 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:42:10.586636 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:42:10.586636 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:42:10.586636 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:42:10.586636 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:42:10.586636 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:42:10.586636 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:42:10.586636 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:42:10.586636 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:42:10.586636 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:42:10.586636 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:42:10.586636 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:42:10.586636 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:42:10.586636 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:42:10.586636 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:42:10.587532 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:42:10.587532 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:42:10.587532 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:42:10.587532 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:42:10.587532 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:42:10.587532 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:42:10.587532 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:42:10.587532 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:42:10.587532 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 403/799] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:42:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:42:10.592946 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0b1bf-8579-4c7e-94ca-97c4dfacf3bb None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:10.689226 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0b1bf-8579-4c7e-94ca-97c4dfacf3bb None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:10.722178 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31cbf63-2c7a-4b1c-a885-3999d0a902d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:10.722862 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cbf63-2c7a-4b1c-a885-3999d0a902d2 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:10.723143 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cbf63-2c7a-4b1c-a885-3999d0a902d2 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:10.723418 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cbf63-2c7a-4b1c-a885-3999d0a902d2 None admin] PATH_INFO: `/v3/projects` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:10.724160 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31cbf63-2c7a-4b1c-a885-3999d0a902d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:42:10.724464 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31cbf63-2c7a-4b1c-a885-3999d0a902d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:10.726371 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31cbf63-2c7a-4b1c-a885-3999d0a902d2 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:10.746035 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 397/800] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Apr 30 20:42:10 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:42:11.910041 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605aac0c-7ffc-443f-b15a-367683a2004d None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:11.910559 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605aac0c-7ffc-443f-b15a-367683a2004d None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:11.910676 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605aac0c-7ffc-443f-b15a-367683a2004d None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:11.911934 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 404/801] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:42:11.917416 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a53fe1-c60c-4702-9c90-1d9fbfbb53f0 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:11.917807 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a53fe1-c60c-4702-9c90-1d9fbfbb53f0 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:11.917977 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a53fe1-c60c-4702-9c90-1d9fbfbb53f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:11.935610 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-c1a53fe1-c60c-4702-9c90-1d9fbfbb53f0 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:42:11.937156 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-c1a53fe1-c60c-4702-9c90-1d9fbfbb53f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:42:12.005914 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 398/802] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:42:11 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:42:12.029136 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605aac0c-7ffc-443f-b15a-367683a2004d None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:12.127158 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605aac0c-7ffc-443f-b15a-367683a2004d None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:12.158362 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d11485-f40b-4bc0-ac0d-762fed466101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:12.159004 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d11485-f40b-4bc0-ac0d-762fed466101 None admin] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:12.159284 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d11485-f40b-4bc0-ac0d-762fed466101 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:12.159555 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d11485-f40b-4bc0-ac0d-762fed466101 None admin] PATH_INFO: `/v3/services` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:12.160252 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d11485-f40b-4bc0-ac0d-762fed466101 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:12.161642 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d11485-f40b-4bc0-ac0d-762fed466101 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:12.262501 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 405/803] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Apr 30 20:42:12 2022] POST /identity/v3/services => generated 242 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:42:13.077673 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57065abf-3c28-490d-953b-fde85bbf893a None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:13.078173 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57065abf-3c28-490d-953b-fde85bbf893a None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:13.078173 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57065abf-3c28-490d-953b-fde85bbf893a None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:13.080075 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 399/804] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:42:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:42:13.085397 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c4bb6-1673-4a8a-be15-315856be6531 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:13.085819 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c4bb6-1673-4a8a-be15-315856be6531 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:13.085952 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c4bb6-1673-4a8a-be15-315856be6531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:13.103282 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-f53c4bb6-1673-4a8a-be15-315856be6531 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:42:13.104509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-f53c4bb6-1673-4a8a-be15-315856be6531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:42:13.174283 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 406/805] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:42:13 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:42:13.199862 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57065abf-3c28-490d-953b-fde85bbf893a None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:13.299166 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57065abf-3c28-490d-953b-fde85bbf893a None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:13.331643 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31ae03-b68a-4325-bd4b-1df0f304c6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:13.332242 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31ae03-b68a-4325-bd4b-1df0f304c6e8 None admin] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:13.332521 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31ae03-b68a-4325-bd4b-1df0f304c6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:13.332794 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31ae03-b68a-4325-bd4b-1df0f304c6e8 None admin] PATH_INFO: `/v3/users` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:13.333514 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31ae03-b68a-4325-bd4b-1df0f304c6e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:13.334931 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31ae03-b68a-4325-bd4b-1df0f304c6e8 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:13.382044 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.sql.core [None req-4f31ae03-b68a-4325-bd4b-1df0f304c6e8 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Apr 30 20:42:13.382044 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Apr 30 20:42:13.382044 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [parameters: {'user_id': 'c3955737e634470b8136f48cc54bdc1d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Apr 30 20:42:13.382044 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=98588) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 30 20:42:13.389299 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-4f31ae03-b68a-4325-bd4b-1df0f304c6e8 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Apr 30 20:42:13.389299 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:42:13.389299 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Apr 30 20:42:13.389299 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application self.dialect.do_execute( Apr 30 20:42:13.389299 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Apr 30 20:42:13.389299 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Apr 30 20:42:13.389299 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Apr 30 20:42:13.389299 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application result = self._query(query) Apr 30 20:42:13.389299 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Apr 30 20:42:13.389299 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application conn.query(q) Apr 30 20:42:13.389299 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Apr 30 20:42:13.389299 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Apr 30 20:42:13.389299 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Apr 30 20:42:13.389299 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application result.read() Apr 30 20:42:13.389299 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Apr 30 20:42:13.390358 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Apr 30 20:42:13.390358 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Apr 30 20:42:13.390358 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application packet.raise_for_error() Apr 30 20:42:13.390358 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Apr 30 20:42:13.390358 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Apr 30 20:42:13.390358 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Apr 30 20:42:13.390358 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Apr 30 20:42:13.390358 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Apr 30 20:42:13.390358 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:42:13.390358 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Apr 30 20:42:13.390358 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:42:13.390358 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:42:13.390358 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Apr 30 20:42:13.390358 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return method(*args, **kwargs) Apr 30 20:42:13.390358 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Apr 30 20:42:13.390358 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Apr 30 20:42:13.390358 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Apr 30 20:42:13.390358 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application next(self.gen) Apr 30 20:42:13.391376 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Apr 30 20:42:13.391376 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application yield resource Apr 30 20:42:13.391376 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Apr 30 20:42:13.391376 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application next(self.gen) Apr 30 20:42:13.391376 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Apr 30 20:42:13.391376 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application self.session.rollback() Apr 30 20:42:13.391376 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Apr 30 20:42:13.391376 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application self.force_reraise() Apr 30 20:42:13.391376 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Apr 30 20:42:13.391376 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise self.value Apr 30 20:42:13.391376 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Apr 30 20:42:13.391376 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Apr 30 20:42:13.391376 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Apr 30 20:42:13.391376 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application session.commit() Apr 30 20:42:13.391376 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1431, in commit Apr 30 20:42:13.391376 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Apr 30 20:42:13.391376 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Apr 30 20:42:13.392594 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application self._prepare_impl() Apr 30 20:42:13.392594 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Apr 30 20:42:13.392594 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application self.session.flush() Apr 30 20:42:13.392594 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3363, in flush Apr 30 20:42:13.392594 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application self._flush(objects) Apr 30 20:42:13.392594 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3503, in _flush Apr 30 20:42:13.392594 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Apr 30 20:42:13.392594 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Apr 30 20:42:13.392594 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application compat.raise_( Apr 30 20:42:13.392594 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Apr 30 20:42:13.392594 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception Apr 30 20:42:13.392594 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3463, in _flush Apr 30 20:42:13.392594 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application flush_context.execute() Apr 30 20:42:13.392594 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Apr 30 20:42:13.392594 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rec.execute(self) Apr 30 20:42:13.392594 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Apr 30 20:42:13.392594 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Apr 30 20:42:13.393535 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Apr 30 20:42:13.393535 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application _emit_insert_statements( Apr 30 20:42:13.393535 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Apr 30 20:42:13.393535 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application result = connection._execute_20( Apr 30 20:42:13.393535 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Apr 30 20:42:13.393535 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Apr 30 20:42:13.393535 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Apr 30 20:42:13.393535 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Apr 30 20:42:13.393535 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Apr 30 20:42:13.393535 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ret = self._execute_context( Apr 30 20:42:13.393535 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Apr 30 20:42:13.393535 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Apr 30 20:42:13.393535 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Apr 30 20:42:13.393535 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Apr 30 20:42:13.393535 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Apr 30 20:42:13.393535 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception Apr 30 20:42:13.394385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Apr 30 20:42:13.394385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application self.dialect.do_execute( Apr 30 20:42:13.394385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Apr 30 20:42:13.394385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Apr 30 20:42:13.394385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Apr 30 20:42:13.394385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application result = self._query(query) Apr 30 20:42:13.394385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Apr 30 20:42:13.394385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application conn.query(q) Apr 30 20:42:13.394385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Apr 30 20:42:13.394385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Apr 30 20:42:13.394385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Apr 30 20:42:13.394385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application result.read() Apr 30 20:42:13.394385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Apr 30 20:42:13.394385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Apr 30 20:42:13.394385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Apr 30 20:42:13.394385 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application packet.raise_for_error() Apr 30 20:42:13.395287 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Apr 30 20:42:13.395287 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Apr 30 20:42:13.395287 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Apr 30 20:42:13.395287 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Apr 30 20:42:13.395287 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Apr 30 20:42:13.395287 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Apr 30 20:42:13.395287 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c3955737e634470b8136f48cc54bdc1d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Apr 30 20:42:13.395287 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Apr 30 20:42:13.395287 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:42:13.395287 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:42:13.395287 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:42:13.395287 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:42:13.395287 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:42:13.395287 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:42:13.395287 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:42:13.397449 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:42:13.397449 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:42:13.397449 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:42:13.397449 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:42:13.397449 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:42:13.397449 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:42:13.397449 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:42:13.397449 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Apr 30 20:42:13.397449 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Apr 30 20:42:13.397449 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:42:13.397449 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:42:13.397449 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:42:13.397449 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:42:13.397449 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:42:13.397449 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:42:13.397449 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Apr 30 20:42:13.397449 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Apr 30 20:42:13.398581 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Apr 30 20:42:13.398581 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Apr 30 20:42:13.398581 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Apr 30 20:42:13.398581 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Apr 30 20:42:13.398581 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Apr 30 20:42:13.398581 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:42:13.398581 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 400/806] 10.222.0.26 () {60 vars in 1131 bytes} [Sat Apr 30 20:42:13 2022] POST /identity/v3/users => generated 160 bytes in 191 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:42:13.399066 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c4bb6-1673-4a8a-be15-315856be6531 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:13.494984 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c4bb6-1673-4a8a-be15-315856be6531 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:13.526721 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04119dfd-568d-4a5c-87fa-234991ab49f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:13.527504 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04119dfd-568d-4a5c-87fa-234991ab49f0 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:13.527784 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04119dfd-568d-4a5c-87fa-234991ab49f0 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:13.528055 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04119dfd-568d-4a5c-87fa-234991ab49f0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:13.535587 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04119dfd-568d-4a5c-87fa-234991ab49f0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:13.537066 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04119dfd-568d-4a5c-87fa-234991ab49f0 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:13.551813 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-04119dfd-568d-4a5c-87fa-234991ab49f0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 30 20:42:13.551813 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:42:13.551813 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:42:13.551813 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:42:13.551813 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:42:13.551813 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:42:13.551813 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:42:13.551813 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:42:13.551813 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:42:13.551813 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:42:13.551813 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:42:13.551813 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:42:13.551813 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:42:13.551813 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:42:13.551813 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:42:13.551813 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:42:13.552895 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:42:13.552895 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:42:13.552895 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:42:13.552895 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:42:13.552895 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:42:13.552895 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:42:13.552895 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:42:13.552895 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:42:13.552895 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:42:13.552895 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:42:13.552895 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:42:13.552895 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:42:13.552895 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:42:13.552895 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:42:13.552895 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:42:13.552895 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:42:13.552895 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:42:13.552895 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:42:13.553884 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:42:13.553884 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:42:13.553884 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:42:13.553884 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:42:13.553884 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:42:13.553884 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:42:13.553884 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:42:13.553884 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:42:13.553884 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Apr 30 20:42:13.553884 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:42:13.553884 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 407/807] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:42:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:42:13.559059 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31ae03-b68a-4325-bd4b-1df0f304c6e8 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:13.655036 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31ae03-b68a-4325-bd4b-1df0f304c6e8 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:13.687861 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f53071-4004-47b7-9a94-da9d066aa503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:13.688547 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f53071-4004-47b7-9a94-da9d066aa503 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:13.688823 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f53071-4004-47b7-9a94-da9d066aa503 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:13.689149 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f53071-4004-47b7-9a94-da9d066aa503 None admin] PATH_INFO: `/v3/users` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:13.689947 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f53071-4004-47b7-9a94-da9d066aa503 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:42:13.690248 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f53071-4004-47b7-9a94-da9d066aa503 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:13.691852 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f53071-4004-47b7-9a94-da9d066aa503 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:13.729490 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 401/808] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Apr 30 20:42:13 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:42:14.564353 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb6bb7-36b3-4aa5-ba88-26e2644c3ba9 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:14.564890 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb6bb7-36b3-4aa5-ba88-26e2644c3ba9 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:14.564890 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb6bb7-36b3-4aa5-ba88-26e2644c3ba9 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:14.566292 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 408/809] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:42:14.572266 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40633140-a306-48c1-b015-bceb9e54fa9b None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:14.572810 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40633140-a306-48c1-b015-bceb9e54fa9b None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:14.572922 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40633140-a306-48c1-b015-bceb9e54fa9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:14.589312 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-40633140-a306-48c1-b015-bceb9e54fa9b None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:42:14.590830 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-40633140-a306-48c1-b015-bceb9e54fa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:42:14.653447 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 402/810] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:42:14 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 30 20:42:14.677270 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb6bb7-36b3-4aa5-ba88-26e2644c3ba9 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:14.772347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb6bb7-36b3-4aa5-ba88-26e2644c3ba9 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:14.804245 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77de937-1a27-4c0c-a4a4-21708a571bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:14.805032 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77de937-1a27-4c0c-a4a4-21708a571bd4 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:14.805315 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77de937-1a27-4c0c-a4a4-21708a571bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:14.805589 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77de937-1a27-4c0c-a4a4-21708a571bd4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:14.806221 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77de937-1a27-4c0c-a4a4-21708a571bd4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:14.807601 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77de937-1a27-4c0c-a4a4-21708a571bd4 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:14.819926 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-d77de937-1a27-4c0c-a4a4-21708a571bd4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 30 20:42:14.819926 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:42:14.819926 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:42:14.819926 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:42:14.819926 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:42:14.819926 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:42:14.819926 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:42:14.819926 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:42:14.819926 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Apr 30 20:42:14.819926 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:42:14.819926 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:42:14.819926 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:42:14.819926 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:42:14.819926 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:42:14.819926 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:42:14.819926 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:42:14.819926 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:42:14.821077 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:42:14.821077 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:42:14.821077 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:42:14.821077 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:42:14.821077 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:42:14.821077 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:42:14.821077 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:42:14.821077 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:42:14.821077 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:42:14.821077 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:42:14.821077 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:42:14.821077 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:42:14.821077 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:42:14.821077 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:42:14.821077 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:42:14.821077 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:42:14.822137 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:42:14.822137 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:42:14.822137 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:42:14.822137 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:42:14.822137 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:42:14.822137 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:42:14.822137 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:42:14.822137 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:42:14.822137 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:42:14.822137 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:42:14.822137 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:42:14.822137 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:42:14.822137 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Apr 30 20:42:14.822137 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:42:14.822137 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 409/811] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:42:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:42:14.827313 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40633140-a306-48c1-b015-bceb9e54fa9b None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:14.919550 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40633140-a306-48c1-b015-bceb9e54fa9b None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:14.951072 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e802c-8bf3-471c-822e-2b72673de1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:14.951715 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e802c-8bf3-471c-822e-2b72673de1e4 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:14.951993 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e802c-8bf3-471c-822e-2b72673de1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:14.952264 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e802c-8bf3-471c-822e-2b72673de1e4 None admin] PATH_INFO: `/v3/services` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:14.952967 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e802c-8bf3-471c-822e-2b72673de1e4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:42:14.953272 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e802c-8bf3-471c-822e-2b72673de1e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:14.954783 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e802c-8bf3-471c-822e-2b72673de1e4 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:14.959382 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 403/812] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Apr 30 20:42:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:42:14.965000 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77de937-1a27-4c0c-a4a4-21708a571bd4 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:15.059743 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77de937-1a27-4c0c-a4a4-21708a571bd4 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:15.090828 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d5a24-0e9d-4a1b-986c-46cb3acfe07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:15.091417 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d5a24-0e9d-4a1b-986c-46cb3acfe07d None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:15.091699 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d5a24-0e9d-4a1b-986c-46cb3acfe07d None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:15.091973 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d5a24-0e9d-4a1b-986c-46cb3acfe07d None admin] PATH_INFO: `/v3/services` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:15.092660 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d5a24-0e9d-4a1b-986c-46cb3acfe07d None admin] RBAC: Adding query filter params (type=compute) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:42:15.092993 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d5a24-0e9d-4a1b-986c-46cb3acfe07d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:15.095083 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d5a24-0e9d-4a1b-986c-46cb3acfe07d None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:15.099621 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 410/813] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Apr 30 20:42:14 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:42:15.105576 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e802c-8bf3-471c-822e-2b72673de1e4 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:15.197683 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e802c-8bf3-471c-822e-2b72673de1e4 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:15.231179 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a05fc-61c6-4e82-859e-674dafd56386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:15.231824 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a05fc-61c6-4e82-859e-674dafd56386 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:15.232104 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a05fc-61c6-4e82-859e-674dafd56386 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:15.232376 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a05fc-61c6-4e82-859e-674dafd56386 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:15.233170 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a05fc-61c6-4e82-859e-674dafd56386 None admin] RBAC: Adding query filter params (interface=public, service_id=6e2b905db828483b8ca314ea7bdc55a0, region_id=RegionOne) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:42:15.233478 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a05fc-61c6-4e82-859e-674dafd56386 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:15.234822 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a05fc-61c6-4e82-859e-674dafd56386 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:15.240802 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 404/814] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Apr 30 20:42:15 2022] GET /identity/v3/endpoints?service_id=6e2b905db828483b8ca314ea7bdc55a0&interface=public®ion_id=RegionOne => generated 194 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:42:15.246284 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d5a24-0e9d-4a1b-986c-46cb3acfe07d None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:15.342080 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d5a24-0e9d-4a1b-986c-46cb3acfe07d None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:15.374032 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d5fa2-d642-4ea9-bafe-7fb947819223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:15.374673 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d5fa2-d642-4ea9-bafe-7fb947819223 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:15.374951 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d5fa2-d642-4ea9-bafe-7fb947819223 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:15.375222 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d5fa2-d642-4ea9-bafe-7fb947819223 None admin] PATH_INFO: `/v3/services` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:15.376493 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d5fa2-d642-4ea9-bafe-7fb947819223 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:15.377876 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d5fa2-d642-4ea9-bafe-7fb947819223 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:15.383802 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 411/815] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Apr 30 20:42:15 2022] GET /identity/v3/services => generated 1728 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 20:42:17.652071 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c974b-2287-4f5d-9bb3-61154dfd97f9 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:17.652596 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c974b-2287-4f5d-9bb3-61154dfd97f9 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:17.652596 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c974b-2287-4f5d-9bb3-61154dfd97f9 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:17.653992 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 405/816] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:42:17.659659 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6e7eb-63d7-4117-848e-e6cd11093f09 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:17.660087 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6e7eb-63d7-4117-848e-e6cd11093f09 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:17.660223 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6e7eb-63d7-4117-848e-e6cd11093f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:17.677696 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-7cd6e7eb-63d7-4117-848e-e6cd11093f09 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:42:17.678861 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-7cd6e7eb-63d7-4117-848e-e6cd11093f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:42:17.742355 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 412/817] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:42:17 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:42:17.765384 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c974b-2287-4f5d-9bb3-61154dfd97f9 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:17.862072 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c974b-2287-4f5d-9bb3-61154dfd97f9 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:17.894701 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87020c95-8a81-406e-a9f2-d0f0fe6d491b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:17.895487 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87020c95-8a81-406e-a9f2-d0f0fe6d491b None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:17.895770 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87020c95-8a81-406e-a9f2-d0f0fe6d491b None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:17.896048 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87020c95-8a81-406e-a9f2-d0f0fe6d491b None admin] PATH_INFO: `/v3/services/compute` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:17.896691 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87020c95-8a81-406e-a9f2-d0f0fe6d491b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:17.898094 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87020c95-8a81-406e-a9f2-d0f0fe6d491b None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:17.910346 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-87020c95-8a81-406e-a9f2-d0f0fe6d491b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 30 20:42:17.910346 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:42:17.910346 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:42:17.910346 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:42:17.910346 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:42:17.910346 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:42:17.910346 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:42:17.910346 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:42:17.910346 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Apr 30 20:42:17.910346 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:42:17.910346 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:42:17.910346 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:42:17.910346 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:42:17.910346 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:42:17.910346 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:42:17.910346 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:42:17.910346 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:42:17.911506 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:42:17.911506 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:42:17.911506 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:42:17.911506 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:42:17.911506 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:42:17.911506 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:42:17.911506 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:42:17.911506 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:42:17.911506 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:42:17.911506 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:42:17.911506 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:42:17.911506 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:42:17.911506 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:42:17.911506 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:42:17.911506 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:42:17.911506 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:42:17.912531 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:42:17.912531 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:42:17.912531 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:42:17.912531 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:42:17.912531 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:42:17.912531 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:42:17.912531 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:42:17.912531 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:42:17.912531 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:42:17.912531 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:42:17.912531 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:42:17.912531 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:42:17.912531 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Apr 30 20:42:17.912531 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:42:17.912531 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 406/818] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:42:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:42:17.917442 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6e7eb-63d7-4117-848e-e6cd11093f09 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:18.012782 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6e7eb-63d7-4117-848e-e6cd11093f09 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:18.045341 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14e759-03eb-4d65-a287-31018ac5c7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:18.045988 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14e759-03eb-4d65-a287-31018ac5c7bc None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:18.046271 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14e759-03eb-4d65-a287-31018ac5c7bc None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:18.046545 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14e759-03eb-4d65-a287-31018ac5c7bc None admin] PATH_INFO: `/v3/services` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:18.047232 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e14e759-03eb-4d65-a287-31018ac5c7bc None admin] RBAC: Adding query filter params (name=compute) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:42:18.048254 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e14e759-03eb-4d65-a287-31018ac5c7bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:18.049888 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e14e759-03eb-4d65-a287-31018ac5c7bc None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:18.054423 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 413/819] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Apr 30 20:42:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:42:18.059897 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87020c95-8a81-406e-a9f2-d0f0fe6d491b None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:18.159020 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87020c95-8a81-406e-a9f2-d0f0fe6d491b None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:18.190283 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbc153-3058-407e-8d4b-a64dc7b202e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:18.190867 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbc153-3058-407e-8d4b-a64dc7b202e6 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:18.191145 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbc153-3058-407e-8d4b-a64dc7b202e6 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:18.191422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbc153-3058-407e-8d4b-a64dc7b202e6 None admin] PATH_INFO: `/v3/services` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:18.192105 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbc153-3058-407e-8d4b-a64dc7b202e6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:42:18.192410 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbc153-3058-407e-8d4b-a64dc7b202e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:18.193784 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbc153-3058-407e-8d4b-a64dc7b202e6 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:18.198325 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 407/820] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Apr 30 20:42:18 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:42:18.204506 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14e759-03eb-4d65-a287-31018ac5c7bc None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:42:18.299667 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14e759-03eb-4d65-a287-31018ac5c7bc None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:42:18.331568 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8ba15-5953-46fe-aedb-4cd0348b45ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:42:18.332220 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8ba15-5953-46fe-aedb-4cd0348b45ef None admin] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:42:18.332499 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8ba15-5953-46fe-aedb-4cd0348b45ef None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:42:18.332878 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8ba15-5953-46fe-aedb-4cd0348b45ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:42:18.333542 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8ba15-5953-46fe-aedb-4cd0348b45ef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:42:18.334910 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8ba15-5953-46fe-aedb-4cd0348b45ef None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:42:18.404542 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 414/821] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Apr 30 20:42:18 2022] POST /identity/v3/endpoints => generated 334 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:43:37.980584 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc32291-b41a-438b-a468-3961e65e10c5 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:37.981182 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc32291-b41a-438b-a468-3961e65e10c5 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:37.981182 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc32291-b41a-438b-a468-3961e65e10c5 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:37.982516 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 408/822] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:43:37.988410 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26362e-009d-49f7-a52a-57a890b30e11 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:37.988873 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26362e-009d-49f7-a52a-57a890b30e11 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:37.988998 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26362e-009d-49f7-a52a-57a890b30e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:38.006019 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-4b26362e-009d-49f7-a52a-57a890b30e11 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:43:38.007190 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-4b26362e-009d-49f7-a52a-57a890b30e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:43:38.077055 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 415/823] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:43:37 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:43:38.104259 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc32291-b41a-438b-a468-3961e65e10c5 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:38.203317 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc32291-b41a-438b-a468-3961e65e10c5 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:38.235766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2304e-cfc9-4b78-9203-1cef242b807a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:38.236548 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2304e-cfc9-4b78-9203-1cef242b807a None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:38.236832 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2304e-cfc9-4b78-9203-1cef242b807a None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:38.237137 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2304e-cfc9-4b78-9203-1cef242b807a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:38.247167 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2304e-cfc9-4b78-9203-1cef242b807a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:38.248656 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2304e-cfc9-4b78-9203-1cef242b807a None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:38.265676 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-f2b2304e-cfc9-4b78-9203-1cef242b807a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:43:38.265676 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:43:38.265676 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:43:38.265676 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:43:38.265676 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:43:38.265676 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:43:38.265676 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:43:38.265676 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:43:38.265676 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:43:38.265676 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:43:38.265676 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:43:38.265676 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:43:38.265676 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:43:38.265676 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:43:38.265676 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:43:38.266822 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:43:38.266822 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:43:38.266822 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:43:38.266822 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:43:38.266822 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:43:38.266822 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:43:38.266822 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:43:38.266822 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:43:38.266822 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:43:38.266822 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:43:38.266822 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:43:38.266822 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:43:38.266822 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:43:38.266822 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:43:38.266822 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:43:38.266822 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:43:38.266822 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:43:38.268054 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:43:38.268054 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:43:38.268054 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:43:38.268054 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:43:38.268054 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 409/824] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:43:38.272876 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26362e-009d-49f7-a52a-57a890b30e11 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:38.367394 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26362e-009d-49f7-a52a-57a890b30e11 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:38.399695 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7137e82-242a-4ab2-bd34-86bb9d254998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:38.400339 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7137e82-242a-4ab2-bd34-86bb9d254998 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:38.400618 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7137e82-242a-4ab2-bd34-86bb9d254998 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:38.400889 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7137e82-242a-4ab2-bd34-86bb9d254998 None admin] PATH_INFO: `/v3/domains` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:38.401620 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7137e82-242a-4ab2-bd34-86bb9d254998 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:43:38.401920 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7137e82-242a-4ab2-bd34-86bb9d254998 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:38.403287 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7137e82-242a-4ab2-bd34-86bb9d254998 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:38.414110 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 416/825] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:43:38.419713 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2304e-cfc9-4b78-9203-1cef242b807a None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:38.518682 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2304e-cfc9-4b78-9203-1cef242b807a None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:38.551295 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cefe6d-c949-481b-b3f5-171527c8fc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:38.551956 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cefe6d-c949-481b-b3f5-171527c8fc46 None admin] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:38.552242 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cefe6d-c949-481b-b3f5-171527c8fc46 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:38.552522 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cefe6d-c949-481b-b3f5-171527c8fc46 None admin] PATH_INFO: `/v3/users` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:38.553261 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cefe6d-c949-481b-b3f5-171527c8fc46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:38.554690 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cefe6d-c949-481b-b3f5-171527c8fc46 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:38.672959 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 410/826] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Apr 30 20:43:38 2022] POST /identity/v3/users => generated 251 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:43:40.983638 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fc59e-0b20-45a1-8dd1-2562109ddd11 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:40.984176 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fc59e-0b20-45a1-8dd1-2562109ddd11 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:40.984176 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fc59e-0b20-45a1-8dd1-2562109ddd11 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:40.985569 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 417/827] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:43:40.990980 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cad79b-d702-4aa4-8a6e-6adddb98eeb6 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:40.991400 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cad79b-d702-4aa4-8a6e-6adddb98eeb6 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:40.991540 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cad79b-d702-4aa4-8a6e-6adddb98eeb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:41.008665 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-d2cad79b-d702-4aa4-8a6e-6adddb98eeb6 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:43:41.011011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-d2cad79b-d702-4aa4-8a6e-6adddb98eeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:43:41.074802 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 411/828] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:43:40 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:43:41.099220 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fc59e-0b20-45a1-8dd1-2562109ddd11 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:41.198877 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fc59e-0b20-45a1-8dd1-2562109ddd11 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:41.231747 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827028b-95f3-4c25-9d95-df058cdaaec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:41.233079 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827028b-95f3-4c25-9d95-df058cdaaec3 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:41.233594 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827028b-95f3-4c25-9d95-df058cdaaec3 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:41.233927 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827028b-95f3-4c25-9d95-df058cdaaec3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:41.244864 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827028b-95f3-4c25-9d95-df058cdaaec3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:43:41.253496 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-d827028b-95f3-4c25-9d95-df058cdaaec3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:43:41.253496 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:43:41.253496 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:43:41.253496 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:43:41.253496 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:43:41.253496 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:43:41.253496 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:43:41.253496 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:43:41.253496 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:43:41.253496 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:43:41.253496 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:43:41.253496 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:43:41.253496 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:43:41.253496 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:43:41.253496 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:43:41.253496 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:43:41.254631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:43:41.254631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:43:41.254631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:43:41.254631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:43:41.254631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:43:41.254631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:43:41.254631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:43:41.254631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:43:41.254631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:43:41.254631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:43:41.254631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:43:41.254631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:43:41.254631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:43:41.254631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:43:41.254631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:43:41.254631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:43:41.255843 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:43:41.255843 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:43:41.255843 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:43:41.255843 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:43:41.255843 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:43:41.255843 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:43:41.255843 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:43:41.255843 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:43:41.255843 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:43:41.255843 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:43:41.255843 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:43:41.255843 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:43:41.255843 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 418/829] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Apr 30 20:43:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:43:41.260680 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cad79b-d702-4aa4-8a6e-6adddb98eeb6 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:41.358771 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cad79b-d702-4aa4-8a6e-6adddb98eeb6 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:41.391602 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2353dd-679b-4593-9484-0e49ad8dfa18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:41.392261 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2353dd-679b-4593-9484-0e49ad8dfa18 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:41.392539 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2353dd-679b-4593-9484-0e49ad8dfa18 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:41.392849 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2353dd-679b-4593-9484-0e49ad8dfa18 None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:41.393612 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2353dd-679b-4593-9484-0e49ad8dfa18 None admin] RBAC: Adding query filter params (name=service) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:43:41.393915 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2353dd-679b-4593-9484-0e49ad8dfa18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:41.395388 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2353dd-679b-4593-9484-0e49ad8dfa18 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:41.403365 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 412/830] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Apr 30 20:43:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:43:41.409644 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827028b-95f3-4c25-9d95-df058cdaaec3 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:41.507180 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827028b-95f3-4c25-9d95-df058cdaaec3 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:41.539903 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72593dca-bd74-4451-ad85-09cd6865e1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:41.540677 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72593dca-bd74-4451-ad85-09cd6865e1d8 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:41.541005 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72593dca-bd74-4451-ad85-09cd6865e1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:41.541282 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72593dca-bd74-4451-ad85-09cd6865e1d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:41.551465 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72593dca-bd74-4451-ad85-09cd6865e1d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:41.553093 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72593dca-bd74-4451-ad85-09cd6865e1d8 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:41.569857 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-72593dca-bd74-4451-ad85-09cd6865e1d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:43:41.569857 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:43:41.569857 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:43:41.569857 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:43:41.569857 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:43:41.569857 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:43:41.569857 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:43:41.569857 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:43:41.569857 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:43:41.569857 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:43:41.569857 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:43:41.569857 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:43:41.569857 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:43:41.569857 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:43:41.569857 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:43:41.570884 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:43:41.570884 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:43:41.570884 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:43:41.570884 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:43:41.570884 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:43:41.570884 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:43:41.570884 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:43:41.570884 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:43:41.570884 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:43:41.570884 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:43:41.570884 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:43:41.570884 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:43:41.570884 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:43:41.570884 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:43:41.570884 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:43:41.570884 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:43:41.570884 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:43:41.571978 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:43:41.571978 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:43:41.571978 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:43:41.571978 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:43:41.571978 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 419/831] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:43:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:43:41.576930 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2353dd-679b-4593-9484-0e49ad8dfa18 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:41.671618 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2353dd-679b-4593-9484-0e49ad8dfa18 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:41.704070 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed98ca2-2226-45b3-9fb5-c900f2e774f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:41.704719 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed98ca2-2226-45b3-9fb5-c900f2e774f4 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:41.705027 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed98ca2-2226-45b3-9fb5-c900f2e774f4 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:41.705302 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed98ca2-2226-45b3-9fb5-c900f2e774f4 None admin] PATH_INFO: `/v3/domains` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:41.706000 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed98ca2-2226-45b3-9fb5-c900f2e774f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:43:41.706305 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed98ca2-2226-45b3-9fb5-c900f2e774f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:41.707659 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed98ca2-2226-45b3-9fb5-c900f2e774f4 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:41.719238 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 413/832] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:43:41.725311 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72593dca-bd74-4451-ad85-09cd6865e1d8 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:41.823033 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72593dca-bd74-4451-ad85-09cd6865e1d8 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:41.856331 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34112017-bfba-4632-b7c4-6302117e377b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:41.857150 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34112017-bfba-4632-b7c4-6302117e377b None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:41.857935 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34112017-bfba-4632-b7c4-6302117e377b None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:41.858353 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34112017-bfba-4632-b7c4-6302117e377b None admin] PATH_INFO: `/v3/users/placement` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:41.865704 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34112017-bfba-4632-b7c4-6302117e377b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:41.867160 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34112017-bfba-4632-b7c4-6302117e377b None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:41.882689 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-34112017-bfba-4632-b7c4-6302117e377b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 30 20:43:41.882689 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:43:41.882689 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:43:41.882689 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:43:41.882689 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:43:41.882689 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:43:41.882689 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:43:41.882689 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:43:41.882689 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:43:41.882689 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:43:41.882689 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:43:41.882689 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:43:41.882689 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:43:41.882689 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:43:41.882689 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:43:41.882689 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:43:41.885905 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:43:41.885905 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:43:41.885905 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:43:41.885905 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:43:41.885905 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:43:41.885905 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:43:41.885905 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:43:41.885905 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:43:41.885905 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:43:41.885905 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:43:41.885905 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:43:41.885905 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:43:41.885905 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:43:41.885905 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:43:41.885905 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:43:41.885905 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:43:41.885905 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:43:41.885905 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:43:41.887050 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:43:41.887050 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:43:41.887050 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:43:41.887050 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:43:41.887050 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:43:41.887050 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:43:41.887050 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:43:41.887050 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:43:41.887050 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Apr 30 20:43:41.887050 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:43:41.887050 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 420/833] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:43:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:43:41.890064 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed98ca2-2226-45b3-9fb5-c900f2e774f4 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:41.986763 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed98ca2-2226-45b3-9fb5-c900f2e774f4 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:42.019100 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08cc2e-eca8-4cf1-a3a5-d377c87d7978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:42.019760 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08cc2e-eca8-4cf1-a3a5-d377c87d7978 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:42.020042 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08cc2e-eca8-4cf1-a3a5-d377c87d7978 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:42.020349 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08cc2e-eca8-4cf1-a3a5-d377c87d7978 None admin] PATH_INFO: `/v3/users` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:42.021192 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08cc2e-eca8-4cf1-a3a5-d377c87d7978 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:43:42.021508 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08cc2e-eca8-4cf1-a3a5-d377c87d7978 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:42.022920 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08cc2e-eca8-4cf1-a3a5-d377c87d7978 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:42.039476 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 414/834] 10.222.0.26 () {56 vars in 1143 bytes} [Sat Apr 30 20:43:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:43:42.045808 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34112017-bfba-4632-b7c4-6302117e377b None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:42.141005 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34112017-bfba-4632-b7c4-6302117e377b None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:42.173291 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e44881-2b6c-4005-84cc-b477acced4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:42.173921 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e44881-2b6c-4005-84cc-b477acced4d2 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:42.174205 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e44881-2b6c-4005-84cc-b477acced4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:42.174539 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e44881-2b6c-4005-84cc-b477acced4d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:42.239605 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e44881-2b6c-4005-84cc-b477acced4d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:42.241060 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e44881-2b6c-4005-84cc-b477acced4d2 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:42.334197 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 421/835] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:43:42 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 30 20:43:42.340185 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08cc2e-eca8-4cf1-a3a5-d377c87d7978 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:42.436188 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08cc2e-eca8-4cf1-a3a5-d377c87d7978 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:42.468795 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fe45d-388f-44fc-a9e5-5a7b3195d72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:42.469604 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fe45d-388f-44fc-a9e5-5a7b3195d72f None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:42.469884 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fe45d-388f-44fc-a9e5-5a7b3195d72f None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:42.470158 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fe45d-388f-44fc-a9e5-5a7b3195d72f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:42.480125 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2fe45d-388f-44fc-a9e5-5a7b3195d72f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:42.481656 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2fe45d-388f-44fc-a9e5-5a7b3195d72f None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:42.499154 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-ff2fe45d-388f-44fc-a9e5-5a7b3195d72f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:43:42.499154 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:43:42.499154 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:43:42.499154 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:43:42.499154 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:43:42.499154 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:43:42.499154 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:43:42.499154 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:43:42.499154 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:43:42.499154 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:43:42.499154 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:43:42.499154 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:43:42.499154 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:43:42.499154 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:43:42.499154 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:43:42.500179 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:43:42.500179 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:43:42.500179 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:43:42.500179 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:43:42.500179 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:43:42.500179 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:43:42.500179 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:43:42.500179 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:43:42.500179 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:43:42.500179 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:43:42.500179 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:43:42.500179 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:43:42.500179 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:43:42.500179 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:43:42.500179 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:43:42.500179 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:43:42.500179 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:43:42.501271 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:43:42.501271 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:43:42.501271 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:43:42.501271 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:43:42.501271 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 415/836] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:43:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:43:42.505904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e44881-2b6c-4005-84cc-b477acced4d2 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:42.602038 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e44881-2b6c-4005-84cc-b477acced4d2 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:42.634770 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa402a57-0d53-4ead-a40e-0fcfdae10aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:42.635449 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa402a57-0d53-4ead-a40e-0fcfdae10aba None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:42.635727 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa402a57-0d53-4ead-a40e-0fcfdae10aba None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:42.635999 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa402a57-0d53-4ead-a40e-0fcfdae10aba None admin] PATH_INFO: `/v3/domains` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:42.636696 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa402a57-0d53-4ead-a40e-0fcfdae10aba None admin] RBAC: Adding query filter params (name=Default) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:43:42.637026 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa402a57-0d53-4ead-a40e-0fcfdae10aba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:42.638393 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa402a57-0d53-4ead-a40e-0fcfdae10aba None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:42.652929 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 422/837] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:43:42.655122 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fe45d-388f-44fc-a9e5-5a7b3195d72f None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:42.750777 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fe45d-388f-44fc-a9e5-5a7b3195d72f None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:42.784146 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42b7af-a23f-4f56-a547-84a395b770e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:42.784941 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42b7af-a23f-4f56-a547-84a395b770e2 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:42.785219 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42b7af-a23f-4f56-a547-84a395b770e2 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:42.785489 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42b7af-a23f-4f56-a547-84a395b770e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:42.791837 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42b7af-a23f-4f56-a547-84a395b770e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:42.793290 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42b7af-a23f-4f56-a547-84a395b770e2 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:42.806526 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-6e42b7af-a23f-4f56-a547-84a395b770e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:43:42.806526 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:43:42.806526 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:43:42.806526 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:43:42.806526 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:43:42.806526 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:43:42.806526 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:43:42.806526 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:43:42.806526 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:43:42.806526 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:43:42.806526 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:43:42.806526 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:43:42.806526 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:43:42.806526 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:43:42.806526 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:43:42.808183 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:43:42.808183 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:43:42.808183 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:43:42.808183 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:43:42.808183 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:43:42.808183 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:43:42.808183 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:43:42.808183 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:43:42.808183 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:43:42.808183 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:43:42.808183 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:43:42.808183 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:43:42.808183 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:43:42.808183 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:43:42.808183 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:43:42.808183 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:43:42.808183 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:43:42.809182 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:43:42.809182 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:43:42.809182 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:43:42.809182 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:43:42.809182 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:43:42.809182 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:43:42.809182 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:43:42.809182 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:43:42.809182 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 416/838] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:43:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:43:42.815974 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa402a57-0d53-4ead-a40e-0fcfdae10aba None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:42.912927 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa402a57-0d53-4ead-a40e-0fcfdae10aba None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:42.944398 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7005f31-031e-4149-9820-dc5e772a68b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:42.945071 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7005f31-031e-4149-9820-dc5e772a68b0 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:42.945353 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7005f31-031e-4149-9820-dc5e772a68b0 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:42.945625 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7005f31-031e-4149-9820-dc5e772a68b0 None admin] PATH_INFO: `/v3/projects` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:42.946389 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7005f31-031e-4149-9820-dc5e772a68b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:43:42.946693 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7005f31-031e-4149-9820-dc5e772a68b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:42.948113 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7005f31-031e-4149-9820-dc5e772a68b0 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:42.962351 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 423/839] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Apr 30 20:43:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:43:42.968448 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42b7af-a23f-4f56-a547-84a395b770e2 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:43.064316 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42b7af-a23f-4f56-a547-84a395b770e2 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:43.096702 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f5284-2f90-4a12-8057-d486be0e8fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:43.097372 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f5284-2f90-4a12-8057-d486be0e8fa3 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:43.097654 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f5284-2f90-4a12-8057-d486be0e8fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:43.097925 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f5284-2f90-4a12-8057-d486be0e8fa3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:43.098784 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f5284-2f90-4a12-8057-d486be0e8fa3 None admin] RBAC: Adding query filter params (role.id=65db0aa5d0b04764ab538efe5f356652, scope.project.id=45ddbc3ac9ff421598cbe53e1252d289, user.id=b6caa91b08d14b598502bfa806c90ebd) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:43:43.099094 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f5284-2f90-4a12-8057-d486be0e8fa3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:43.100771 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f5284-2f90-4a12-8057-d486be0e8fa3 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:43.106001 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 417/840] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Apr 30 20:43:42 2022] GET /identity/v3/role_assignments?user.id=b6caa91b08d14b598502bfa806c90ebd&scope.project.id=45ddbc3ac9ff421598cbe53e1252d289&role.id=65db0aa5d0b04764ab538efe5f356652 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:43:45.381894 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39349c1a-cade-4996-a0a2-9de3a1d30673 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:45.382440 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39349c1a-cade-4996-a0a2-9de3a1d30673 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:45.382440 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39349c1a-cade-4996-a0a2-9de3a1d30673 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:45.383820 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 424/841] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:43:45.389037 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff6189-40e7-4a59-884d-232e65e3ee37 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:45.389454 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff6189-40e7-4a59-884d-232e65e3ee37 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:45.389590 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff6189-40e7-4a59-884d-232e65e3ee37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:45.406438 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-68ff6189-40e7-4a59-884d-232e65e3ee37 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:43:45.407598 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-68ff6189-40e7-4a59-884d-232e65e3ee37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:43:45.471788 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 418/842] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:43:45 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:43:45.495665 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39349c1a-cade-4996-a0a2-9de3a1d30673 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:45.594138 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39349c1a-cade-4996-a0a2-9de3a1d30673 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:45.626924 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3edfc6-b5dd-4de3-8124-1a29c52a610d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:45.627710 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3edfc6-b5dd-4de3-8124-1a29c52a610d None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:45.627989 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3edfc6-b5dd-4de3-8124-1a29c52a610d None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:45.628264 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3edfc6-b5dd-4de3-8124-1a29c52a610d None admin] PATH_INFO: `/v3/roles/service` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:45.638232 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3edfc6-b5dd-4de3-8124-1a29c52a610d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:43:45.646294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-de3edfc6-b5dd-4de3-8124-1a29c52a610d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:43:45.646294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:43:45.646294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:43:45.646294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:43:45.646294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:43:45.646294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:43:45.646294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:43:45.646294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:43:45.646294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:43:45.646294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:43:45.646294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:43:45.646294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:43:45.646294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:43:45.646294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:43:45.646294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:43:45.646294 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:43:45.648753 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:43:45.648753 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:43:45.648753 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:43:45.648753 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:43:45.648753 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:43:45.648753 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:43:45.648753 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:43:45.648753 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:43:45.648753 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:43:45.648753 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:43:45.648753 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:43:45.648753 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:43:45.648753 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:43:45.648753 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:43:45.648753 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:43:45.648753 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:43:45.649815 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:43:45.649815 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:43:45.649815 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:43:45.649815 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:43:45.649815 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:43:45.649815 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:43:45.649815 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:43:45.649815 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:43:45.649815 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:43:45.649815 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:43:45.649815 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:43:45.649815 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:43:45.649815 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 425/843] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Apr 30 20:43:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:43:45.653744 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff6189-40e7-4a59-884d-232e65e3ee37 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:45.748213 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff6189-40e7-4a59-884d-232e65e3ee37 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:45.780913 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc32444-bfeb-4990-8af5-146e6f5b130d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:45.781594 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc32444-bfeb-4990-8af5-146e6f5b130d None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:45.785206 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc32444-bfeb-4990-8af5-146e6f5b130d None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:45.785206 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc32444-bfeb-4990-8af5-146e6f5b130d None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:45.785206 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc32444-bfeb-4990-8af5-146e6f5b130d None admin] RBAC: Adding query filter params (name=service) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:43:45.785206 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc32444-bfeb-4990-8af5-146e6f5b130d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:45.785206 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc32444-bfeb-4990-8af5-146e6f5b130d None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:45.792335 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 419/844] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Apr 30 20:43:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:43:45.798517 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3edfc6-b5dd-4de3-8124-1a29c52a610d None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:45.896315 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3edfc6-b5dd-4de3-8124-1a29c52a610d None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:45.928225 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9b842-7726-4f19-8f8c-d0a135aaf610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:45.929143 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9b842-7726-4f19-8f8c-d0a135aaf610 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:45.929428 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9b842-7726-4f19-8f8c-d0a135aaf610 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:45.929703 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9b842-7726-4f19-8f8c-d0a135aaf610 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:45.940357 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e9b842-7726-4f19-8f8c-d0a135aaf610 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:45.941848 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e9b842-7726-4f19-8f8c-d0a135aaf610 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:45.959867 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-18e9b842-7726-4f19-8f8c-d0a135aaf610 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:43:45.959867 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:43:45.959867 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:43:45.959867 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:43:45.959867 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:43:45.959867 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:43:45.959867 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:43:45.959867 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:43:45.959867 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:43:45.959867 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:43:45.959867 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:43:45.959867 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:43:45.959867 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:43:45.959867 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:43:45.959867 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:43:45.960937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:43:45.960937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:43:45.960937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:43:45.960937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:43:45.960937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:43:45.960937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:43:45.960937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:43:45.960937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:43:45.960937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:43:45.960937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:43:45.960937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:43:45.960937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:43:45.960937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:43:45.960937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:43:45.960937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:43:45.960937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:43:45.960937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:43:45.962093 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:43:45.962093 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:43:45.962093 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:43:45.962093 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:43:45.962093 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 426/845] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:43:45.966838 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc32444-bfeb-4990-8af5-146e6f5b130d None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:46.063753 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc32444-bfeb-4990-8af5-146e6f5b130d None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:46.096070 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392aa96-8eb6-49de-b314-c293da71610e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:46.096722 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392aa96-8eb6-49de-b314-c293da71610e None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:46.097037 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392aa96-8eb6-49de-b314-c293da71610e None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:46.097314 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392aa96-8eb6-49de-b314-c293da71610e None admin] PATH_INFO: `/v3/domains` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:46.098022 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392aa96-8eb6-49de-b314-c293da71610e None admin] RBAC: Adding query filter params (name=Default) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:43:46.098330 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392aa96-8eb6-49de-b314-c293da71610e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:46.099963 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392aa96-8eb6-49de-b314-c293da71610e None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:46.111873 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 420/846] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:43:46.117325 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9b842-7726-4f19-8f8c-d0a135aaf610 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:46.212668 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9b842-7726-4f19-8f8c-d0a135aaf610 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:46.246174 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b7ce3-4971-4e3a-aa21-b4e68ddf9ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:46.246968 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b7ce3-4971-4e3a-aa21-b4e68ddf9ec6 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:46.247245 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b7ce3-4971-4e3a-aa21-b4e68ddf9ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:46.247515 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b7ce3-4971-4e3a-aa21-b4e68ddf9ec6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:46.255504 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b7ce3-4971-4e3a-aa21-b4e68ddf9ec6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:46.256982 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b7ce3-4971-4e3a-aa21-b4e68ddf9ec6 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:46.271183 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-2a0b7ce3-4971-4e3a-aa21-b4e68ddf9ec6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 30 20:43:46.271183 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:43:46.271183 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:43:46.271183 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:43:46.271183 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:43:46.271183 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:43:46.271183 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:43:46.271183 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:43:46.271183 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:43:46.271183 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:43:46.271183 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:43:46.271183 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:43:46.271183 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:43:46.271183 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:43:46.271183 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:43:46.271183 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:43:46.272238 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:43:46.272238 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:43:46.272238 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:43:46.272238 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:43:46.272238 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:43:46.272238 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:43:46.272238 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:43:46.272238 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:43:46.272238 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:43:46.272238 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:43:46.272238 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:43:46.272238 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:43:46.272238 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:43:46.272238 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:43:46.272238 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:43:46.272238 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:43:46.272238 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:43:46.272238 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:43:46.273603 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:43:46.273603 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:43:46.273603 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:43:46.273603 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:43:46.273603 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:43:46.273603 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:43:46.273603 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:43:46.273603 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:43:46.273603 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Apr 30 20:43:46.273603 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:43:46.273603 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 427/847] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:43:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:43:46.278294 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392aa96-8eb6-49de-b314-c293da71610e None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:46.373311 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392aa96-8eb6-49de-b314-c293da71610e None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:46.406520 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af040296-4d8b-4011-a6e7-5e3a10db1b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:46.407209 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af040296-4d8b-4011-a6e7-5e3a10db1b38 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:46.407493 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af040296-4d8b-4011-a6e7-5e3a10db1b38 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:46.407769 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af040296-4d8b-4011-a6e7-5e3a10db1b38 None admin] PATH_INFO: `/v3/users` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:46.408590 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af040296-4d8b-4011-a6e7-5e3a10db1b38 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:43:46.408928 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af040296-4d8b-4011-a6e7-5e3a10db1b38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:46.410402 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af040296-4d8b-4011-a6e7-5e3a10db1b38 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:46.428606 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 421/848] 10.222.0.26 () {56 vars in 1143 bytes} [Sat Apr 30 20:43:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:43:46.434323 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b7ce3-4971-4e3a-aa21-b4e68ddf9ec6 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:46.531462 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b7ce3-4971-4e3a-aa21-b4e68ddf9ec6 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:46.563438 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbcedc-261e-4697-9815-545787dc447f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:46.564216 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbcedc-261e-4697-9815-545787dc447f None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:46.564497 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbcedc-261e-4697-9815-545787dc447f None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:46.564768 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbcedc-261e-4697-9815-545787dc447f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:46.574728 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afbcedc-261e-4697-9815-545787dc447f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:46.576807 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afbcedc-261e-4697-9815-545787dc447f None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:46.593870 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-1afbcedc-261e-4697-9815-545787dc447f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:43:46.593870 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:43:46.593870 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:43:46.593870 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:43:46.593870 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:43:46.593870 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:43:46.593870 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:43:46.593870 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:43:46.593870 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:43:46.593870 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:43:46.593870 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:43:46.593870 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:43:46.593870 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:43:46.593870 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:43:46.593870 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:43:46.594793 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:43:46.594793 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:43:46.594793 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:43:46.594793 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:43:46.594793 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:43:46.594793 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:43:46.594793 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:43:46.594793 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:43:46.594793 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:43:46.594793 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:43:46.594793 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:43:46.594793 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:43:46.594793 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:43:46.594793 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:43:46.594793 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:43:46.594793 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:43:46.594793 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:43:46.595745 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:43:46.595745 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:43:46.595745 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:43:46.595745 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:43:46.595745 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 428/849] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:43:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:43:46.600973 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af040296-4d8b-4011-a6e7-5e3a10db1b38 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:46.694615 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af040296-4d8b-4011-a6e7-5e3a10db1b38 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:46.727203 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e7508-844c-42bd-82b8-a53e51ca714a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:46.727857 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e7508-844c-42bd-82b8-a53e51ca714a None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:46.728137 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e7508-844c-42bd-82b8-a53e51ca714a None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:46.728424 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e7508-844c-42bd-82b8-a53e51ca714a None admin] PATH_INFO: `/v3/domains` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:46.729155 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e7508-844c-42bd-82b8-a53e51ca714a None admin] RBAC: Adding query filter params (name=Default) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:43:46.729462 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e7508-844c-42bd-82b8-a53e51ca714a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:46.730817 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e7508-844c-42bd-82b8-a53e51ca714a None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:46.741848 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 422/850] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:43:46.747684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbcedc-261e-4697-9815-545787dc447f None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:46.845644 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbcedc-261e-4697-9815-545787dc447f None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:46.877768 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee824dc-de50-4523-9569-efa754b0e0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:46.878541 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee824dc-de50-4523-9569-efa754b0e0a7 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:46.878820 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee824dc-de50-4523-9569-efa754b0e0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:46.879092 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee824dc-de50-4523-9569-efa754b0e0a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:46.885505 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee824dc-de50-4523-9569-efa754b0e0a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:46.886975 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee824dc-de50-4523-9569-efa754b0e0a7 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:46.900948 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-fee824dc-de50-4523-9569-efa754b0e0a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:43:46.900948 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:43:46.900948 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:43:46.900948 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:43:46.900948 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:43:46.900948 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:43:46.900948 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:43:46.900948 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:43:46.900948 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:43:46.900948 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:43:46.900948 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:43:46.900948 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:43:46.900948 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:43:46.900948 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:43:46.900948 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:43:46.901995 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:43:46.901995 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:43:46.901995 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:43:46.901995 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:43:46.901995 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:43:46.901995 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:43:46.901995 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:43:46.901995 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:43:46.901995 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:43:46.901995 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:43:46.901995 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:43:46.901995 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:43:46.901995 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:43:46.901995 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:43:46.901995 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:43:46.901995 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:43:46.901995 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:43:46.902890 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:43:46.902890 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:43:46.902890 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:43:46.902890 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:43:46.902890 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:43:46.902890 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:43:46.902890 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:43:46.902890 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:43:46.902890 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 429/851] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:43:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:43:46.908539 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e7508-844c-42bd-82b8-a53e51ca714a None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:47.007116 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e7508-844c-42bd-82b8-a53e51ca714a None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:47.040299 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e4933-01ef-45cd-9e4f-7c556dd2a947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:47.040987 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e4933-01ef-45cd-9e4f-7c556dd2a947 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:47.041274 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e4933-01ef-45cd-9e4f-7c556dd2a947 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:47.041553 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e4933-01ef-45cd-9e4f-7c556dd2a947 None admin] PATH_INFO: `/v3/projects` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:47.042327 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e4933-01ef-45cd-9e4f-7c556dd2a947 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:43:47.042645 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e4933-01ef-45cd-9e4f-7c556dd2a947 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:47.044077 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e4933-01ef-45cd-9e4f-7c556dd2a947 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:47.056193 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 423/852] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Apr 30 20:43:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:43:47.062549 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee824dc-de50-4523-9569-efa754b0e0a7 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:47.159494 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee824dc-de50-4523-9569-efa754b0e0a7 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:47.191812 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c575a-b88b-40e3-b067-6d6238352746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:47.192713 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c575a-b88b-40e3-b067-6d6238352746 None admin] REQUEST_METHOD: `PUT` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:47.193022 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c575a-b88b-40e3-b067-6d6238352746 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:47.194197 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c575a-b88b-40e3-b067-6d6238352746 None admin] PATH_INFO: `/v3/projects/45ddbc3ac9ff421598cbe53e1252d289/users/b6caa91b08d14b598502bfa806c90ebd/roles/65db0aa5d0b04764ab538efe5f356652` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:47.207929 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c575a-b88b-40e3-b067-6d6238352746 None admin] RBAC: Authorizing `identity:create_grant(project_id=45ddbc3ac9ff421598cbe53e1252d289, user_id=b6caa91b08d14b598502bfa806c90ebd, role_id=65db0aa5d0b04764ab538efe5f356652)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:47.209426 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c575a-b88b-40e3-b067-6d6238352746 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:47.288034 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 430/853] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Apr 30 20:43:47 2022] PUT /identity/v3/projects/45ddbc3ac9ff421598cbe53e1252d289/users/b6caa91b08d14b598502bfa806c90ebd/roles/65db0aa5d0b04764ab538efe5f356652 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:43:49.538390 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0ff3a-252f-49cb-80a0-e9c12f8ded31 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:49.538941 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0ff3a-252f-49cb-80a0-e9c12f8ded31 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:49.538941 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0ff3a-252f-49cb-80a0-e9c12f8ded31 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:49.540298 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 424/854] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:43:49.545501 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fdd5e-49e3-452a-a829-a4ed65fcea17 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:49.545909 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fdd5e-49e3-452a-a829-a4ed65fcea17 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:49.546054 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fdd5e-49e3-452a-a829-a4ed65fcea17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:49.562022 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-4e9fdd5e-49e3-452a-a829-a4ed65fcea17 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:43:49.563183 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-4e9fdd5e-49e3-452a-a829-a4ed65fcea17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:43:49.628874 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 431/855] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:43:49 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:43:49.654065 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0ff3a-252f-49cb-80a0-e9c12f8ded31 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:49.752400 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0ff3a-252f-49cb-80a0-e9c12f8ded31 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:49.785279 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97b3e0-7e94-4a58-8939-1db68b4156f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:49.786065 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97b3e0-7e94-4a58-8939-1db68b4156f7 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:49.786344 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97b3e0-7e94-4a58-8939-1db68b4156f7 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:49.786617 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97b3e0-7e94-4a58-8939-1db68b4156f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:49.796744 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97b3e0-7e94-4a58-8939-1db68b4156f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:43:49.804443 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-fb97b3e0-7e94-4a58-8939-1db68b4156f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:43:49.804443 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:43:49.804443 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:43:49.804443 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:43:49.804443 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:43:49.804443 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:43:49.804443 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:43:49.804443 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:43:49.804443 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:43:49.804443 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:43:49.804443 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:43:49.804443 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:43:49.804443 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:43:49.804443 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:43:49.804443 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:43:49.804443 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:43:49.806280 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:43:49.806280 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:43:49.806280 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:43:49.806280 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:43:49.806280 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:43:49.806280 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:43:49.806280 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:43:49.806280 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:43:49.806280 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:43:49.806280 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:43:49.806280 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:43:49.806280 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:43:49.806280 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:43:49.806280 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:43:49.806280 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:43:49.806280 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:43:49.807219 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:43:49.807219 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:43:49.807219 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:43:49.807219 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:43:49.807219 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:43:49.807219 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:43:49.807219 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:43:49.807219 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:43:49.807219 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:43:49.807219 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:43:49.807219 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:43:49.807219 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:43:49.807219 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 425/856] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Apr 30 20:43:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:43:49.812514 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fdd5e-49e3-452a-a829-a4ed65fcea17 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:49.907742 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fdd5e-49e3-452a-a829-a4ed65fcea17 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:49.939842 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa4d93-debb-42de-9d1d-8094f9a56d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:49.940523 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa4d93-debb-42de-9d1d-8094f9a56d2e None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:49.940802 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa4d93-debb-42de-9d1d-8094f9a56d2e None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:49.941105 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa4d93-debb-42de-9d1d-8094f9a56d2e None admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:49.941836 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa4d93-debb-42de-9d1d-8094f9a56d2e None admin] RBAC: Adding query filter params (name=service) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:43:49.952938 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa4d93-debb-42de-9d1d-8094f9a56d2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:49.952938 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa4d93-debb-42de-9d1d-8094f9a56d2e None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:49.952938 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 432/857] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Apr 30 20:43:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:43:49.957590 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97b3e0-7e94-4a58-8939-1db68b4156f7 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:50.055530 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97b3e0-7e94-4a58-8939-1db68b4156f7 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:50.087414 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a23a2d-2239-46c7-bae9-7c43f7ea7360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:50.088189 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a23a2d-2239-46c7-bae9-7c43f7ea7360 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:50.088470 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a23a2d-2239-46c7-bae9-7c43f7ea7360 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:50.089613 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a23a2d-2239-46c7-bae9-7c43f7ea7360 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:50.099071 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a23a2d-2239-46c7-bae9-7c43f7ea7360 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:50.100794 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a23a2d-2239-46c7-bae9-7c43f7ea7360 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:50.118008 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-d6a23a2d-2239-46c7-bae9-7c43f7ea7360 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:43:50.118008 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:43:50.118008 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:43:50.118008 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:43:50.118008 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:43:50.118008 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:43:50.118008 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:43:50.118008 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:43:50.118008 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:43:50.118008 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:43:50.118008 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:43:50.118008 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:43:50.118008 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:43:50.118008 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:43:50.118008 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:43:50.119112 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:43:50.119112 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:43:50.119112 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:43:50.119112 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:43:50.119112 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:43:50.119112 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:43:50.119112 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:43:50.119112 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:43:50.119112 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:43:50.119112 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:43:50.119112 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:43:50.119112 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:43:50.119112 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:43:50.119112 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:43:50.119112 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:43:50.119112 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:43:50.119112 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:43:50.120060 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:43:50.120060 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:43:50.120060 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:43:50.120060 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:43:50.120060 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 426/858] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:43:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:43:50.125454 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa4d93-debb-42de-9d1d-8094f9a56d2e None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:50.343721 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa4d93-debb-42de-9d1d-8094f9a56d2e None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:50.375860 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6a30c-4da5-4b01-ba80-2f30afb8b50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:50.376511 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6a30c-4da5-4b01-ba80-2f30afb8b50c None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:50.376789 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6a30c-4da5-4b01-ba80-2f30afb8b50c None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:50.377092 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6a30c-4da5-4b01-ba80-2f30afb8b50c None admin] PATH_INFO: `/v3/domains` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:50.377793 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6a30c-4da5-4b01-ba80-2f30afb8b50c None admin] RBAC: Adding query filter params (name=Default) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:43:50.378094 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6a30c-4da5-4b01-ba80-2f30afb8b50c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:50.379460 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6a30c-4da5-4b01-ba80-2f30afb8b50c None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:50.390419 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 433/859] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:43:50.396113 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a23a2d-2239-46c7-bae9-7c43f7ea7360 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:50.493362 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a23a2d-2239-46c7-bae9-7c43f7ea7360 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:50.525462 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154da5b3-e115-4165-95b9-b9c0b9976b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:50.526250 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154da5b3-e115-4165-95b9-b9c0b9976b9a None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:50.526529 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154da5b3-e115-4165-95b9-b9c0b9976b9a None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:50.526803 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154da5b3-e115-4165-95b9-b9c0b9976b9a None admin] PATH_INFO: `/v3/users/placement` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:50.534760 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154da5b3-e115-4165-95b9-b9c0b9976b9a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:50.536187 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154da5b3-e115-4165-95b9-b9c0b9976b9a None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:50.550619 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-154da5b3-e115-4165-95b9-b9c0b9976b9a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 30 20:43:50.550619 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:43:50.550619 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:43:50.550619 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:43:50.550619 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:43:50.550619 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:43:50.550619 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:43:50.550619 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:43:50.550619 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:43:50.550619 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:43:50.550619 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:43:50.550619 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:43:50.550619 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:43:50.550619 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:43:50.550619 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:43:50.550619 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:43:50.552176 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:43:50.552176 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:43:50.552176 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:43:50.552176 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:43:50.552176 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:43:50.552176 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:43:50.552176 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:43:50.552176 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:43:50.552176 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:43:50.552176 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:43:50.552176 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:43:50.552176 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:43:50.552176 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:43:50.552176 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:43:50.552176 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:43:50.552176 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:43:50.552176 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:43:50.552176 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:43:50.553594 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:43:50.553594 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:43:50.553594 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:43:50.553594 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:43:50.553594 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:43:50.553594 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:43:50.553594 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:43:50.553594 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:43:50.553594 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Apr 30 20:43:50.553594 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:43:50.553594 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 427/860] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:43:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:43:50.557546 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6a30c-4da5-4b01-ba80-2f30afb8b50c None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:50.657769 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6a30c-4da5-4b01-ba80-2f30afb8b50c None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:50.690104 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbce196-1578-4011-bac6-06b08784125a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:50.690759 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbce196-1578-4011-bac6-06b08784125a None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:50.691040 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbce196-1578-4011-bac6-06b08784125a None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:50.691314 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbce196-1578-4011-bac6-06b08784125a None admin] PATH_INFO: `/v3/users` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:50.692130 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbce196-1578-4011-bac6-06b08784125a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:43:50.692437 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbce196-1578-4011-bac6-06b08784125a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:50.693977 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbce196-1578-4011-bac6-06b08784125a None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:50.710779 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 434/861] 10.222.0.26 () {56 vars in 1143 bytes} [Sat Apr 30 20:43:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:43:50.716509 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154da5b3-e115-4165-95b9-b9c0b9976b9a None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:50.811494 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154da5b3-e115-4165-95b9-b9c0b9976b9a None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:50.845339 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e065ee0-f704-491c-bae4-dda7d49b2968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:50.845980 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e065ee0-f704-491c-bae4-dda7d49b2968 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:50.846259 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e065ee0-f704-491c-bae4-dda7d49b2968 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:50.846540 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e065ee0-f704-491c-bae4-dda7d49b2968 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:50.910571 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e065ee0-f704-491c-bae4-dda7d49b2968 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:50.911934 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e065ee0-f704-491c-bae4-dda7d49b2968 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:51.005098 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 428/862] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:43:50 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 30 20:43:51.010928 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbce196-1578-4011-bac6-06b08784125a None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:51.105487 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbce196-1578-4011-bac6-06b08784125a None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:51.138075 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf2d0f-1c0a-4995-b584-5089aa29f705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:51.139479 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf2d0f-1c0a-4995-b584-5089aa29f705 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:51.139759 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf2d0f-1c0a-4995-b584-5089aa29f705 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:51.140033 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf2d0f-1c0a-4995-b584-5089aa29f705 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:51.149746 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf2d0f-1c0a-4995-b584-5089aa29f705 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:51.151208 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf2d0f-1c0a-4995-b584-5089aa29f705 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:51.168070 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-63bf2d0f-1c0a-4995-b584-5089aa29f705 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:43:51.168070 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:43:51.168070 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:43:51.168070 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:43:51.168070 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:43:51.168070 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:43:51.168070 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:43:51.168070 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:43:51.168070 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:43:51.168070 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:43:51.168070 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:43:51.168070 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:43:51.168070 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:43:51.168070 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:43:51.168070 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:43:51.168993 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:43:51.168993 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:43:51.168993 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:43:51.168993 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:43:51.168993 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:43:51.168993 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:43:51.168993 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:43:51.168993 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:43:51.168993 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:43:51.168993 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:43:51.168993 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:43:51.168993 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:43:51.168993 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:43:51.168993 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:43:51.168993 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:43:51.168993 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:43:51.168993 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:43:51.169926 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:43:51.169926 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:43:51.169926 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:43:51.169926 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:43:51.169926 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 435/863] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:43:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:43:51.175529 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e065ee0-f704-491c-bae4-dda7d49b2968 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:51.271961 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e065ee0-f704-491c-bae4-dda7d49b2968 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:51.304579 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf9df2-eed0-430a-9773-e7a85a1918bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:51.305266 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf9df2-eed0-430a-9773-e7a85a1918bb None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:51.305551 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf9df2-eed0-430a-9773-e7a85a1918bb None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:51.305830 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf9df2-eed0-430a-9773-e7a85a1918bb None admin] PATH_INFO: `/v3/domains` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:51.306540 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf9df2-eed0-430a-9773-e7a85a1918bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:43:51.306850 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf9df2-eed0-430a-9773-e7a85a1918bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:51.308210 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf9df2-eed0-430a-9773-e7a85a1918bb None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:51.319675 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 429/864] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:43:51.325301 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf2d0f-1c0a-4995-b584-5089aa29f705 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:51.421559 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf2d0f-1c0a-4995-b584-5089aa29f705 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:51.454496 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d89a45-5a9a-4285-bf4c-bc0d8d8a5baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:51.455270 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d89a45-5a9a-4285-bf4c-bc0d8d8a5baf None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:51.455549 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d89a45-5a9a-4285-bf4c-bc0d8d8a5baf None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:51.455818 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d89a45-5a9a-4285-bf4c-bc0d8d8a5baf None admin] PATH_INFO: `/v3/projects/service` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:51.462333 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d89a45-5a9a-4285-bf4c-bc0d8d8a5baf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:51.463810 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d89a45-5a9a-4285-bf4c-bc0d8d8a5baf None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:51.478700 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-b9d89a45-5a9a-4285-bf4c-bc0d8d8a5baf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:43:51.478700 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:43:51.478700 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:43:51.478700 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:43:51.478700 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:43:51.478700 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:43:51.478700 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:43:51.478700 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:43:51.478700 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:43:51.478700 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:43:51.478700 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:43:51.478700 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:43:51.478700 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:43:51.478700 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:43:51.478700 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:43:51.479634 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:43:51.479634 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:43:51.479634 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:43:51.479634 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:43:51.479634 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:43:51.479634 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:43:51.479634 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:43:51.479634 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:43:51.479634 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:43:51.479634 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:43:51.479634 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:43:51.479634 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:43:51.479634 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:43:51.479634 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:43:51.479634 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:43:51.479634 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:43:51.479634 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:43:51.481110 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:43:51.481110 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:43:51.481110 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:43:51.481110 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:43:51.481110 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:43:51.481110 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:43:51.481110 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:43:51.481110 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:43:51.481110 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 436/865] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:43:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:43:51.486024 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf9df2-eed0-430a-9773-e7a85a1918bb None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:51.584592 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf9df2-eed0-430a-9773-e7a85a1918bb None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:51.617281 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e442730-22af-4647-b89a-8f670ac0384f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:51.617931 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e442730-22af-4647-b89a-8f670ac0384f None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:51.618213 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e442730-22af-4647-b89a-8f670ac0384f None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:51.618488 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e442730-22af-4647-b89a-8f670ac0384f None admin] PATH_INFO: `/v3/projects` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:51.619260 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e442730-22af-4647-b89a-8f670ac0384f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:43:51.619571 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e442730-22af-4647-b89a-8f670ac0384f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:51.621015 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e442730-22af-4647-b89a-8f670ac0384f None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:51.633327 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 430/866] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Apr 30 20:43:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:43:51.639503 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d89a45-5a9a-4285-bf4c-bc0d8d8a5baf None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:51.735247 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d89a45-5a9a-4285-bf4c-bc0d8d8a5baf None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:51.767789 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf0e06-baa4-4291-b509-fee54cb99ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:51.768427 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf0e06-baa4-4291-b509-fee54cb99ddf None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:51.768708 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf0e06-baa4-4291-b509-fee54cb99ddf None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:51.769010 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf0e06-baa4-4291-b509-fee54cb99ddf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:51.769822 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf0e06-baa4-4291-b509-fee54cb99ddf None admin] RBAC: Adding query filter params (role.id=65db0aa5d0b04764ab538efe5f356652, scope.project.id=45ddbc3ac9ff421598cbe53e1252d289, user.id=b6caa91b08d14b598502bfa806c90ebd) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:43:51.770130 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf0e06-baa4-4291-b509-fee54cb99ddf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:51.771562 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf0e06-baa4-4291-b509-fee54cb99ddf None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:51.777249 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 437/867] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Apr 30 20:43:51 2022] GET /identity/v3/role_assignments?user.id=b6caa91b08d14b598502bfa806c90ebd&scope.project.id=45ddbc3ac9ff421598cbe53e1252d289&role.id=65db0aa5d0b04764ab538efe5f356652 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:43:54.123810 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922a359-a6f1-43d6-b9b5-3e525a0e1fdf None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:54.124354 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922a359-a6f1-43d6-b9b5-3e525a0e1fdf None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:54.124354 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922a359-a6f1-43d6-b9b5-3e525a0e1fdf None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:54.125664 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 431/868] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:43:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:43:54.130993 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be2680-4689-41e8-acd9-305c39a62c81 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:54.131414 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be2680-4689-41e8-acd9-305c39a62c81 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:54.131523 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be2680-4689-41e8-acd9-305c39a62c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:54.148414 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-82be2680-4689-41e8-acd9-305c39a62c81 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:43:54.149624 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-82be2680-4689-41e8-acd9-305c39a62c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:43:54.213769 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 438/869] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:43:54 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:43:54.238672 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922a359-a6f1-43d6-b9b5-3e525a0e1fdf None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:54.337795 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922a359-a6f1-43d6-b9b5-3e525a0e1fdf None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:54.370561 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974f52f-71f9-47a2-9cd5-b4f5b0244962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:54.371343 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974f52f-71f9-47a2-9cd5-b4f5b0244962 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:54.371648 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974f52f-71f9-47a2-9cd5-b4f5b0244962 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:54.371919 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974f52f-71f9-47a2-9cd5-b4f5b0244962 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:54.382626 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974f52f-71f9-47a2-9cd5-b4f5b0244962 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:43:54.390880 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-2974f52f-71f9-47a2-9cd5-b4f5b0244962 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:43:54.390880 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:43:54.390880 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:43:54.390880 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:43:54.390880 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:43:54.390880 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:43:54.390880 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:43:54.390880 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:43:54.390880 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:43:54.390880 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:43:54.390880 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:43:54.390880 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:43:54.390880 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:43:54.390880 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:43:54.390880 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:43:54.390880 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:43:54.391963 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:43:54.391963 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:43:54.391963 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:43:54.391963 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:43:54.391963 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:43:54.391963 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:43:54.391963 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:43:54.391963 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:43:54.391963 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:43:54.391963 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:43:54.391963 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:43:54.391963 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:43:54.391963 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:43:54.391963 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:43:54.391963 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:43:54.391963 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:43:54.392862 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:43:54.392862 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:43:54.392862 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:43:54.392862 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:43:54.392862 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:43:54.392862 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:43:54.392862 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:43:54.392862 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:43:54.392862 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:43:54.392862 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:43:54.392862 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:43:54.392862 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:43:54.392862 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 432/870] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Apr 30 20:43:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:43:54.398165 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be2680-4689-41e8-acd9-305c39a62c81 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:54.491619 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be2680-4689-41e8-acd9-305c39a62c81 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:54.523276 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade608f9-adfc-48fa-8083-2f4c84e812e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:54.523929 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade608f9-adfc-48fa-8083-2f4c84e812e7 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:54.524208 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade608f9-adfc-48fa-8083-2f4c84e812e7 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:54.524495 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade608f9-adfc-48fa-8083-2f4c84e812e7 None admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:54.525238 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade608f9-adfc-48fa-8083-2f4c84e812e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:43:54.525541 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade608f9-adfc-48fa-8083-2f4c84e812e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:54.526905 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade608f9-adfc-48fa-8083-2f4c84e812e7 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:54.534862 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 439/871] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:43:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:43:54.546070 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974f52f-71f9-47a2-9cd5-b4f5b0244962 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:54.636271 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974f52f-71f9-47a2-9cd5-b4f5b0244962 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:54.668414 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40429100-a1f3-457c-b6c8-bf3b4b9e8c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:54.669295 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40429100-a1f3-457c-b6c8-bf3b4b9e8c28 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:54.670072 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40429100-a1f3-457c-b6c8-bf3b4b9e8c28 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:54.670564 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40429100-a1f3-457c-b6c8-bf3b4b9e8c28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:54.680818 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40429100-a1f3-457c-b6c8-bf3b4b9e8c28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:54.682293 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40429100-a1f3-457c-b6c8-bf3b4b9e8c28 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:54.699716 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-40429100-a1f3-457c-b6c8-bf3b4b9e8c28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:43:54.699716 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:43:54.699716 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:43:54.699716 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:43:54.699716 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:43:54.699716 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:43:54.699716 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:43:54.699716 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:43:54.699716 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:43:54.699716 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:43:54.699716 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:43:54.699716 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:43:54.699716 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:43:54.699716 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:43:54.699716 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:43:54.700927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:43:54.700927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:43:54.700927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:43:54.700927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:43:54.700927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:43:54.700927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:43:54.700927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:43:54.700927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:43:54.700927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:43:54.700927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:43:54.700927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:43:54.700927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:43:54.700927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:43:54.700927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:43:54.700927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:43:54.700927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:43:54.700927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:43:54.702237 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:43:54.702237 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:43:54.702237 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:43:54.702237 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:43:54.702237 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 433/872] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:43:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:43:54.706721 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade608f9-adfc-48fa-8083-2f4c84e812e7 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:54.803061 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade608f9-adfc-48fa-8083-2f4c84e812e7 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:54.835827 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f07942-8750-44d1-8d53-2543b2a82569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:54.837592 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f07942-8750-44d1-8d53-2543b2a82569 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:54.837592 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f07942-8750-44d1-8d53-2543b2a82569 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:54.837592 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f07942-8750-44d1-8d53-2543b2a82569 None admin] PATH_INFO: `/v3/domains` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:54.837844 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f07942-8750-44d1-8d53-2543b2a82569 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:43:54.838019 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f07942-8750-44d1-8d53-2543b2a82569 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:54.839388 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f07942-8750-44d1-8d53-2543b2a82569 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:54.851561 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 440/873] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:43:54.857452 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40429100-a1f3-457c-b6c8-bf3b4b9e8c28 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:54.955197 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40429100-a1f3-457c-b6c8-bf3b4b9e8c28 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:54.986732 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd3826-29ba-4565-b78e-3481d9bf925a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:54.992518 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd3826-29ba-4565-b78e-3481d9bf925a None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:54.992518 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd3826-29ba-4565-b78e-3481d9bf925a None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:54.992518 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd3826-29ba-4565-b78e-3481d9bf925a None admin] PATH_INFO: `/v3/users/placement` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:54.995389 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd3826-29ba-4565-b78e-3481d9bf925a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:54.996816 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd3826-29ba-4565-b78e-3481d9bf925a None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:55.011469 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-9dbd3826-29ba-4565-b78e-3481d9bf925a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 30 20:43:55.011469 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:43:55.011469 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:43:55.011469 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:43:55.011469 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:43:55.011469 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:43:55.011469 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:43:55.011469 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:43:55.011469 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:43:55.011469 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:43:55.011469 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:43:55.011469 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:43:55.011469 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:43:55.011469 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:43:55.011469 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:43:55.011469 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:43:55.012570 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:43:55.012570 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:43:55.012570 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:43:55.012570 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:43:55.012570 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:43:55.012570 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:43:55.012570 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:43:55.012570 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:43:55.012570 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:43:55.012570 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:43:55.012570 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:43:55.012570 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:43:55.012570 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:43:55.012570 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:43:55.012570 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:43:55.012570 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:43:55.012570 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:43:55.012570 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:43:55.014328 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:43:55.014328 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:43:55.014328 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:43:55.014328 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:43:55.014328 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:43:55.014328 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:43:55.014328 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:43:55.014328 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:43:55.014328 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Apr 30 20:43:55.014328 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:43:55.014328 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 434/874] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:43:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:43:55.019197 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f07942-8750-44d1-8d53-2543b2a82569 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:55.116442 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f07942-8750-44d1-8d53-2543b2a82569 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:55.150518 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73c05d-0d4c-4cba-bed2-ef4a15e2fca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:55.151175 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73c05d-0d4c-4cba-bed2-ef4a15e2fca8 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:55.151478 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73c05d-0d4c-4cba-bed2-ef4a15e2fca8 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:55.151752 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73c05d-0d4c-4cba-bed2-ef4a15e2fca8 None admin] PATH_INFO: `/v3/users` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:55.152571 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73c05d-0d4c-4cba-bed2-ef4a15e2fca8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:43:55.152947 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73c05d-0d4c-4cba-bed2-ef4a15e2fca8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:55.154739 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73c05d-0d4c-4cba-bed2-ef4a15e2fca8 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:55.172672 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 441/875] 10.222.0.26 () {56 vars in 1143 bytes} [Sat Apr 30 20:43:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:43:55.178460 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd3826-29ba-4565-b78e-3481d9bf925a None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:55.278277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd3826-29ba-4565-b78e-3481d9bf925a None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:55.310886 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115796b4-a89e-4d52-86ae-5bf9bf9ab872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:55.311872 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115796b4-a89e-4d52-86ae-5bf9bf9ab872 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:55.312115 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115796b4-a89e-4d52-86ae-5bf9bf9ab872 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:55.312389 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115796b4-a89e-4d52-86ae-5bf9bf9ab872 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:55.378253 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115796b4-a89e-4d52-86ae-5bf9bf9ab872 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:55.379707 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115796b4-a89e-4d52-86ae-5bf9bf9ab872 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:55.474069 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 435/876] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:43:55 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 30 20:43:55.480296 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73c05d-0d4c-4cba-bed2-ef4a15e2fca8 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:55.575659 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73c05d-0d4c-4cba-bed2-ef4a15e2fca8 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:55.608645 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d34a3-8ad8-4c18-9b7b-94bb0157b191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:55.609456 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d34a3-8ad8-4c18-9b7b-94bb0157b191 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:55.609738 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d34a3-8ad8-4c18-9b7b-94bb0157b191 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:55.610008 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d34a3-8ad8-4c18-9b7b-94bb0157b191 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:55.619668 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d34a3-8ad8-4c18-9b7b-94bb0157b191 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:55.621177 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d34a3-8ad8-4c18-9b7b-94bb0157b191 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:55.638708 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-d30d34a3-8ad8-4c18-9b7b-94bb0157b191 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:43:55.638708 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:43:55.638708 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:43:55.638708 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:43:55.638708 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:43:55.638708 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:43:55.638708 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:43:55.638708 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:43:55.638708 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:43:55.638708 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:43:55.638708 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:43:55.638708 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:43:55.638708 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:43:55.638708 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:43:55.638708 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:43:55.639760 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:43:55.639760 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:43:55.639760 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:43:55.639760 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:43:55.639760 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:43:55.639760 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:43:55.639760 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:43:55.639760 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:43:55.639760 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:43:55.639760 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:43:55.639760 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:43:55.639760 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:43:55.639760 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:43:55.639760 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:43:55.639760 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:43:55.639760 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:43:55.639760 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:43:55.640851 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:43:55.640851 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:43:55.640851 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:43:55.640851 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:43:55.640851 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 442/877] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:43:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:43:55.645743 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115796b4-a89e-4d52-86ae-5bf9bf9ab872 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:55.740085 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115796b4-a89e-4d52-86ae-5bf9bf9ab872 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:55.771326 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfa7d1-2c56-4693-8a87-58b4df5b83bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:55.771980 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfa7d1-2c56-4693-8a87-58b4df5b83bf None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:55.777214 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfa7d1-2c56-4693-8a87-58b4df5b83bf None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:55.777214 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfa7d1-2c56-4693-8a87-58b4df5b83bf None admin] PATH_INFO: `/v3/domains` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:55.777214 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfa7d1-2c56-4693-8a87-58b4df5b83bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:43:55.777214 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfa7d1-2c56-4693-8a87-58b4df5b83bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:55.777214 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfa7d1-2c56-4693-8a87-58b4df5b83bf None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:55.786677 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 436/878] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:43:55.792342 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d34a3-8ad8-4c18-9b7b-94bb0157b191 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:55.889205 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d34a3-8ad8-4c18-9b7b-94bb0157b191 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:55.920800 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3c9cb-1058-4946-8790-6d5b6de3c45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:55.921603 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3c9cb-1058-4946-8790-6d5b6de3c45e None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:55.921883 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3c9cb-1058-4946-8790-6d5b6de3c45e None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:55.922155 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3c9cb-1058-4946-8790-6d5b6de3c45e None admin] PATH_INFO: `/v3/projects/service` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:55.928537 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e3c9cb-1058-4946-8790-6d5b6de3c45e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:55.930020 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e3c9cb-1058-4946-8790-6d5b6de3c45e None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:55.944244 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-a5e3c9cb-1058-4946-8790-6d5b6de3c45e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:43:55.944244 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:43:55.944244 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:43:55.944244 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:43:55.944244 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:43:55.944244 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:43:55.944244 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:43:55.944244 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:43:55.944244 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:43:55.944244 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:43:55.944244 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:43:55.944244 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:43:55.944244 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:43:55.944244 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:43:55.944244 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:43:55.945332 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:43:55.945332 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:43:55.945332 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:43:55.945332 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:43:55.945332 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:43:55.945332 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:43:55.945332 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:43:55.945332 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:43:55.945332 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:43:55.945332 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:43:55.945332 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:43:55.945332 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:43:55.945332 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:43:55.945332 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:43:55.945332 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:43:55.945332 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:43:55.945332 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:43:55.946303 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:43:55.946303 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:43:55.946303 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:43:55.946303 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:43:55.946303 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:43:55.946303 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:43:55.946303 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:43:55.946303 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:43:55.946303 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 443/879] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:43:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:43:55.952144 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfa7d1-2c56-4693-8a87-58b4df5b83bf None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:56.047460 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfa7d1-2c56-4693-8a87-58b4df5b83bf None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:56.079687 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778afc92-4b67-45e4-9195-95c2ac2c59ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:56.080335 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778afc92-4b67-45e4-9195-95c2ac2c59ae None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:56.080614 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778afc92-4b67-45e4-9195-95c2ac2c59ae None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:56.080888 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778afc92-4b67-45e4-9195-95c2ac2c59ae None admin] PATH_INFO: `/v3/projects` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:56.081691 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778afc92-4b67-45e4-9195-95c2ac2c59ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:43:56.081997 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778afc92-4b67-45e4-9195-95c2ac2c59ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:56.083403 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778afc92-4b67-45e4-9195-95c2ac2c59ae None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:56.094952 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 437/880] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Apr 30 20:43:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:43:56.101487 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3c9cb-1058-4946-8790-6d5b6de3c45e None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:56.197808 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3c9cb-1058-4946-8790-6d5b6de3c45e None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:56.229767 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0896e5-0f98-4409-8303-fb6c5a5978ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:56.230415 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0896e5-0f98-4409-8303-fb6c5a5978ef None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:56.230699 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0896e5-0f98-4409-8303-fb6c5a5978ef None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:56.230977 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0896e5-0f98-4409-8303-fb6c5a5978ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:56.232715 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0896e5-0f98-4409-8303-fb6c5a5978ef None admin] RBAC: Adding query filter params (role.id=31b3f11a82cd4cd2823e88aa0e931323, scope.project.id=45ddbc3ac9ff421598cbe53e1252d289, user.id=b6caa91b08d14b598502bfa806c90ebd) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:43:56.233224 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0896e5-0f98-4409-8303-fb6c5a5978ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:56.234697 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0896e5-0f98-4409-8303-fb6c5a5978ef None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:56.240110 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 444/881] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Apr 30 20:43:56 2022] GET /identity/v3/role_assignments?user.id=b6caa91b08d14b598502bfa806c90ebd&scope.project.id=45ddbc3ac9ff421598cbe53e1252d289&role.id=31b3f11a82cd4cd2823e88aa0e931323 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:43:58.512228 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebee232-a496-4781-bb58-521b7af66192 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:58.512778 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebee232-a496-4781-bb58-521b7af66192 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:58.512778 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebee232-a496-4781-bb58-521b7af66192 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:58.514218 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 438/882] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:43:58.519338 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7d993-39e1-4655-bb70-7f12d8789bf4 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:58.519733 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7d993-39e1-4655-bb70-7f12d8789bf4 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:58.519926 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7d993-39e1-4655-bb70-7f12d8789bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:58.536439 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-ecb7d993-39e1-4655-bb70-7f12d8789bf4 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:43:58.537660 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-ecb7d993-39e1-4655-bb70-7f12d8789bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:43:58.601702 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 445/883] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:43:58 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:43:58.625630 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebee232-a496-4781-bb58-521b7af66192 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:58.723222 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebee232-a496-4781-bb58-521b7af66192 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:58.755660 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ceea82-e469-4143-9c85-d99157991135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:58.756436 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ceea82-e469-4143-9c85-d99157991135 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:58.756713 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ceea82-e469-4143-9c85-d99157991135 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:58.757011 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ceea82-e469-4143-9c85-d99157991135 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:58.766778 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ceea82-e469-4143-9c85-d99157991135 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:43:58.774277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-b2ceea82-e469-4143-9c85-d99157991135 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:43:58.774277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:43:58.774277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:43:58.774277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:43:58.774277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:43:58.774277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:43:58.774277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:43:58.774277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:43:58.774277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:43:58.774277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:43:58.774277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:43:58.774277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:43:58.774277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:43:58.774277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:43:58.774277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:43:58.774277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:43:58.778185 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:43:58.778185 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:43:58.778185 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:43:58.778185 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:43:58.778185 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:43:58.778185 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:43:58.778185 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:43:58.778185 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:43:58.778185 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:43:58.778185 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:43:58.778185 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:43:58.778185 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:43:58.778185 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:43:58.778185 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:43:58.778185 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:43:58.778185 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:43:58.779751 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:43:58.779751 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:43:58.779751 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:43:58.779751 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:43:58.779751 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:43:58.779751 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:43:58.779751 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:43:58.779751 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:43:58.779751 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:43:58.779751 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:43:58.779751 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:43:58.779751 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:43:58.779751 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 439/884] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Apr 30 20:43:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:43:58.782059 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7d993-39e1-4655-bb70-7f12d8789bf4 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:58.876798 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7d993-39e1-4655-bb70-7f12d8789bf4 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:58.908634 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c39031-7fbc-4113-bb51-df6ffba6d42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:58.909313 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c39031-7fbc-4113-bb51-df6ffba6d42b None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:58.909592 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c39031-7fbc-4113-bb51-df6ffba6d42b None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:58.909860 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c39031-7fbc-4113-bb51-df6ffba6d42b None admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:58.910584 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c39031-7fbc-4113-bb51-df6ffba6d42b None admin] RBAC: Adding query filter params (name=admin) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:43:58.910886 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c39031-7fbc-4113-bb51-df6ffba6d42b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:58.912254 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c39031-7fbc-4113-bb51-df6ffba6d42b None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:58.920674 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 446/885] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:43:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:43:58.926543 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ceea82-e469-4143-9c85-d99157991135 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:59.023238 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ceea82-e469-4143-9c85-d99157991135 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:59.055564 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb44854-815d-4575-84d6-9920342ed50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:59.056341 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb44854-815d-4575-84d6-9920342ed50d None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:59.056620 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb44854-815d-4575-84d6-9920342ed50d None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:59.056893 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb44854-815d-4575-84d6-9920342ed50d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:59.067303 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb44854-815d-4575-84d6-9920342ed50d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:59.068728 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb44854-815d-4575-84d6-9920342ed50d None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:59.085728 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-acb44854-815d-4575-84d6-9920342ed50d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:43:59.085728 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:43:59.085728 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:43:59.085728 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:43:59.085728 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:43:59.085728 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:43:59.085728 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:43:59.085728 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:43:59.085728 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:43:59.085728 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:43:59.085728 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:43:59.085728 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:43:59.085728 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:43:59.085728 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:43:59.085728 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:43:59.086836 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:43:59.086836 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:43:59.086836 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:43:59.086836 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:43:59.086836 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:43:59.086836 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:43:59.086836 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:43:59.086836 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:43:59.086836 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:43:59.086836 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:43:59.086836 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:43:59.086836 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:43:59.086836 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:43:59.086836 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:43:59.086836 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:43:59.086836 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:43:59.086836 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:43:59.088088 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:43:59.088088 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:43:59.088088 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:43:59.088088 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:43:59.088088 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 440/886] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:43:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:43:59.093448 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c39031-7fbc-4113-bb51-df6ffba6d42b None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:59.188895 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c39031-7fbc-4113-bb51-df6ffba6d42b None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:59.221732 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd06c4-91c1-459b-9eee-fe8e2d37d543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:59.222378 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd06c4-91c1-459b-9eee-fe8e2d37d543 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:59.222656 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd06c4-91c1-459b-9eee-fe8e2d37d543 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:59.222929 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd06c4-91c1-459b-9eee-fe8e2d37d543 None admin] PATH_INFO: `/v3/domains` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:59.223628 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd06c4-91c1-459b-9eee-fe8e2d37d543 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:43:59.223930 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd06c4-91c1-459b-9eee-fe8e2d37d543 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:59.225670 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd06c4-91c1-459b-9eee-fe8e2d37d543 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:59.236990 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 447/887] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:43:59.242746 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb44854-815d-4575-84d6-9920342ed50d None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:59.339802 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb44854-815d-4575-84d6-9920342ed50d None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:59.373479 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67094a-6dd0-4009-9641-53ab30bbccc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:59.374373 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67094a-6dd0-4009-9641-53ab30bbccc0 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:59.374655 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67094a-6dd0-4009-9641-53ab30bbccc0 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:59.374930 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67094a-6dd0-4009-9641-53ab30bbccc0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:59.382275 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67094a-6dd0-4009-9641-53ab30bbccc0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:59.391628 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67094a-6dd0-4009-9641-53ab30bbccc0 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:59.399049 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-1b67094a-6dd0-4009-9641-53ab30bbccc0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 30 20:43:59.399049 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:43:59.399049 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:43:59.399049 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:43:59.399049 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:43:59.399049 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:43:59.399049 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:43:59.399049 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:43:59.399049 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:43:59.399049 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:43:59.399049 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:43:59.399049 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:43:59.399049 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:43:59.399049 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:43:59.399049 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:43:59.399049 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:43:59.400120 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:43:59.400120 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:43:59.400120 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:43:59.400120 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:43:59.400120 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:43:59.400120 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:43:59.400120 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:43:59.400120 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:43:59.400120 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:43:59.400120 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:43:59.400120 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:43:59.400120 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:43:59.400120 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:43:59.400120 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:43:59.400120 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:43:59.400120 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:43:59.400120 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:43:59.400120 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:43:59.406136 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:43:59.406136 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:43:59.406136 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:43:59.406136 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:43:59.406136 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:43:59.406136 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:43:59.406136 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:43:59.406136 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:43:59.406136 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Apr 30 20:43:59.406136 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:43:59.406136 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 441/888] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:43:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:43:59.406850 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd06c4-91c1-459b-9eee-fe8e2d37d543 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:59.502141 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd06c4-91c1-459b-9eee-fe8e2d37d543 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:59.534789 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe84bac-de6d-454c-a40d-eb01a3b4188f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:59.535452 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe84bac-de6d-454c-a40d-eb01a3b4188f None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:59.535732 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe84bac-de6d-454c-a40d-eb01a3b4188f None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:59.536004 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe84bac-de6d-454c-a40d-eb01a3b4188f None admin] PATH_INFO: `/v3/users` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:59.536824 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe84bac-de6d-454c-a40d-eb01a3b4188f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:43:59.537159 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe84bac-de6d-454c-a40d-eb01a3b4188f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:59.538654 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe84bac-de6d-454c-a40d-eb01a3b4188f None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:59.555597 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 448/889] 10.222.0.26 () {56 vars in 1143 bytes} [Sat Apr 30 20:43:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:43:59.562031 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67094a-6dd0-4009-9641-53ab30bbccc0 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:59.658501 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67094a-6dd0-4009-9641-53ab30bbccc0 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:59.691950 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a7415-846c-49f1-a378-9d06c81f9065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:59.692725 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a7415-846c-49f1-a378-9d06c81f9065 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:59.693044 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a7415-846c-49f1-a378-9d06c81f9065 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:59.693319 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a7415-846c-49f1-a378-9d06c81f9065 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:59.703950 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a7415-846c-49f1-a378-9d06c81f9065 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:59.705418 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a7415-846c-49f1-a378-9d06c81f9065 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:59.722190 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-271a7415-846c-49f1-a378-9d06c81f9065 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:43:59.722190 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:43:59.722190 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:43:59.722190 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:43:59.722190 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:43:59.722190 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:43:59.722190 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:43:59.722190 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:43:59.722190 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:43:59.722190 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:43:59.722190 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:43:59.722190 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:43:59.722190 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:43:59.722190 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:43:59.722190 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:43:59.723271 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:43:59.723271 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:43:59.723271 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:43:59.723271 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:43:59.723271 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:43:59.723271 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:43:59.723271 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:43:59.723271 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:43:59.723271 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:43:59.723271 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:43:59.723271 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:43:59.723271 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:43:59.723271 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:43:59.723271 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:43:59.723271 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:43:59.723271 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:43:59.723271 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:43:59.724570 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:43:59.724570 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:43:59.724570 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:43:59.724570 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:43:59.724570 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 442/890] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:43:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:43:59.729394 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe84bac-de6d-454c-a40d-eb01a3b4188f None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:59.827104 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe84bac-de6d-454c-a40d-eb01a3b4188f None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:43:59.861080 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1df7b-e58f-49d8-975b-2597ba373c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:43:59.861733 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1df7b-e58f-49d8-975b-2597ba373c3f None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:43:59.862011 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1df7b-e58f-49d8-975b-2597ba373c3f None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:43:59.862281 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1df7b-e58f-49d8-975b-2597ba373c3f None admin] PATH_INFO: `/v3/domains` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:43:59.862991 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c1df7b-e58f-49d8-975b-2597ba373c3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:43:59.863295 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c1df7b-e58f-49d8-975b-2597ba373c3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:43:59.864660 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c1df7b-e58f-49d8-975b-2597ba373c3f None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:43:59.876082 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 449/891] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:43:59.881667 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a7415-846c-49f1-a378-9d06c81f9065 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:43:59.977444 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a7415-846c-49f1-a378-9d06c81f9065 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:44:00.010646 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac346cc-af09-4f64-9fce-87fe5bcca653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:44:00.011432 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac346cc-af09-4f64-9fce-87fe5bcca653 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:44:00.011717 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac346cc-af09-4f64-9fce-87fe5bcca653 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:44:00.011992 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac346cc-af09-4f64-9fce-87fe5bcca653 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:44:00.018493 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac346cc-af09-4f64-9fce-87fe5bcca653 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:44:00.019937 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac346cc-af09-4f64-9fce-87fe5bcca653 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:44:00.033902 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-cac346cc-af09-4f64-9fce-87fe5bcca653 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:44:00.033902 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:44:00.033902 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:44:00.033902 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:44:00.033902 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:44:00.033902 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:44:00.033902 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:44:00.033902 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:44:00.033902 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:44:00.033902 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:44:00.033902 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:44:00.033902 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:44:00.033902 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:44:00.033902 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:44:00.033902 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:44:00.034926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:44:00.034926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:44:00.034926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:44:00.034926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:44:00.034926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:44:00.034926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:44:00.034926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:44:00.034926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:44:00.034926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:44:00.034926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:44:00.034926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:44:00.034926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:44:00.034926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:44:00.034926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:44:00.034926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:44:00.034926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:44:00.034926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:44:00.035922 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:44:00.035922 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:44:00.035922 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:44:00.035922 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:44:00.035922 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:44:00.035922 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:44:00.035922 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:44:00.035922 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:44:00.035922 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 443/892] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:43:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:44:00.041006 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1df7b-e58f-49d8-975b-2597ba373c3f None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:44:00.139202 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1df7b-e58f-49d8-975b-2597ba373c3f None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:44:00.172448 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be236f6-8640-4828-b016-09e783d8ad06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:44:00.173111 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be236f6-8640-4828-b016-09e783d8ad06 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:44:00.173394 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be236f6-8640-4828-b016-09e783d8ad06 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:44:00.173666 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be236f6-8640-4828-b016-09e783d8ad06 None admin] PATH_INFO: `/v3/projects` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:44:00.174430 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be236f6-8640-4828-b016-09e783d8ad06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:44:00.174734 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be236f6-8640-4828-b016-09e783d8ad06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:44:00.176157 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be236f6-8640-4828-b016-09e783d8ad06 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:44:00.187756 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 450/893] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Apr 30 20:44:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:44:00.193891 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac346cc-af09-4f64-9fce-87fe5bcca653 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:44:00.289487 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac346cc-af09-4f64-9fce-87fe5bcca653 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:44:00.321936 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8322dc-4939-4837-be5a-1bfa68d42692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:44:00.322891 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8322dc-4939-4837-be5a-1bfa68d42692 None admin] REQUEST_METHOD: `PUT` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:44:00.323090 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8322dc-4939-4837-be5a-1bfa68d42692 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:44:00.323363 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8322dc-4939-4837-be5a-1bfa68d42692 None admin] PATH_INFO: `/v3/projects/45ddbc3ac9ff421598cbe53e1252d289/users/b6caa91b08d14b598502bfa806c90ebd/roles/31b3f11a82cd4cd2823e88aa0e931323` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:44:00.325332 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8322dc-4939-4837-be5a-1bfa68d42692 None admin] RBAC: Authorizing `identity:create_grant(project_id=45ddbc3ac9ff421598cbe53e1252d289, user_id=b6caa91b08d14b598502bfa806c90ebd, role_id=31b3f11a82cd4cd2823e88aa0e931323)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:44:00.326959 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8322dc-4939-4837-be5a-1bfa68d42692 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:44:00.415658 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 444/894] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Apr 30 20:44:00 2022] PUT /identity/v3/projects/45ddbc3ac9ff421598cbe53e1252d289/users/b6caa91b08d14b598502bfa806c90ebd/roles/31b3f11a82cd4cd2823e88aa0e931323 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:44:02.707091 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d224d8-d735-4d93-b886-ceaa76cd9d17 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:44:02.707643 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d224d8-d735-4d93-b886-ceaa76cd9d17 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:44:02.707643 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d224d8-d735-4d93-b886-ceaa76cd9d17 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:44:02.709013 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 451/895] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:44:02.714329 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb985c-f604-4f48-b61d-c805c4a61378 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:44:02.714798 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb985c-f604-4f48-b61d-c805c4a61378 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:44:02.714884 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb985c-f604-4f48-b61d-c805c4a61378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:44:02.732981 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-0bfb985c-f604-4f48-b61d-c805c4a61378 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:44:02.734192 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-0bfb985c-f604-4f48-b61d-c805c4a61378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:44:02.797491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 445/896] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:44:02 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:44:02.821498 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d224d8-d735-4d93-b886-ceaa76cd9d17 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:44:02.920366 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d224d8-d735-4d93-b886-ceaa76cd9d17 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:44:02.954311 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df68051-bc8e-42cc-acee-7c7f357917a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:44:02.955092 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df68051-bc8e-42cc-acee-7c7f357917a6 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:44:02.955370 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df68051-bc8e-42cc-acee-7c7f357917a6 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:44:02.955644 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df68051-bc8e-42cc-acee-7c7f357917a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:44:02.965858 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df68051-bc8e-42cc-acee-7c7f357917a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:44:02.973894 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-5df68051-bc8e-42cc-acee-7c7f357917a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:44:02.973894 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:44:02.973894 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:44:02.973894 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:44:02.973894 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:44:02.973894 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:44:02.973894 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:44:02.973894 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:44:02.973894 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:44:02.973894 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:44:02.973894 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:44:02.973894 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:44:02.973894 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:44:02.973894 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:44:02.973894 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:44:02.973894 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:44:02.975126 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:44:02.975126 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:44:02.975126 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:44:02.975126 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:44:02.975126 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:44:02.975126 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:44:02.975126 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:44:02.975126 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:44:02.975126 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:44:02.975126 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:44:02.975126 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:44:02.975126 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:44:02.975126 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:44:02.975126 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:44:02.975126 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:44:02.975126 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:44:02.976001 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:44:02.976001 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:44:02.976001 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:44:02.976001 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:44:02.976001 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:44:02.976001 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:44:02.976001 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:44:02.976001 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:44:02.976001 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:44:02.976001 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:44:02.976001 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:44:02.976001 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:44:02.976001 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 452/897] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Apr 30 20:44:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:44:02.981331 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb985c-f604-4f48-b61d-c805c4a61378 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:44:03.074960 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb985c-f604-4f48-b61d-c805c4a61378 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:44:03.109561 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9742fc-6438-40f6-a582-e5c53244669b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:44:03.110221 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9742fc-6438-40f6-a582-e5c53244669b None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:44:03.110508 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9742fc-6438-40f6-a582-e5c53244669b None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:44:03.110786 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9742fc-6438-40f6-a582-e5c53244669b None admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:44:03.111520 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9742fc-6438-40f6-a582-e5c53244669b None admin] RBAC: Adding query filter params (name=admin) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:44:03.111831 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9742fc-6438-40f6-a582-e5c53244669b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:44:03.113238 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9742fc-6438-40f6-a582-e5c53244669b None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:44:03.121145 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 446/898] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Apr 30 20:44:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:44:03.127267 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df68051-bc8e-42cc-acee-7c7f357917a6 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:44:03.224530 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df68051-bc8e-42cc-acee-7c7f357917a6 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:44:03.257332 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12277e6b-3038-44d2-95f2-d2f5f8a64453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:44:03.258120 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12277e6b-3038-44d2-95f2-d2f5f8a64453 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:44:03.258399 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12277e6b-3038-44d2-95f2-d2f5f8a64453 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:44:03.258671 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12277e6b-3038-44d2-95f2-d2f5f8a64453 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:44:03.268799 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12277e6b-3038-44d2-95f2-d2f5f8a64453 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:44:03.270266 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12277e6b-3038-44d2-95f2-d2f5f8a64453 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:44:03.286933 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-12277e6b-3038-44d2-95f2-d2f5f8a64453 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:44:03.286933 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:44:03.286933 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:44:03.286933 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:44:03.286933 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:44:03.286933 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:44:03.286933 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:44:03.286933 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:44:03.286933 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:44:03.286933 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:44:03.286933 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:44:03.286933 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:44:03.286933 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:44:03.286933 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:44:03.286933 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:44:03.287969 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:44:03.287969 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:44:03.287969 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:44:03.287969 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:44:03.287969 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:44:03.287969 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:44:03.287969 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:44:03.287969 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:44:03.287969 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:44:03.287969 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:44:03.287969 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:44:03.287969 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:44:03.287969 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:44:03.287969 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:44:03.287969 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:44:03.287969 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:44:03.287969 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:44:03.288900 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:44:03.288900 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:44:03.288900 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:44:03.288900 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:44:03.288900 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 453/899] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:44:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:44:03.293941 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9742fc-6438-40f6-a582-e5c53244669b None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:44:03.390814 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9742fc-6438-40f6-a582-e5c53244669b None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:44:03.423975 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77b1cc-a5d2-4494-af3b-ecf832ebfc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:44:03.424631 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77b1cc-a5d2-4494-af3b-ecf832ebfc55 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:44:03.424937 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77b1cc-a5d2-4494-af3b-ecf832ebfc55 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:44:03.425244 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77b1cc-a5d2-4494-af3b-ecf832ebfc55 None admin] PATH_INFO: `/v3/domains` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:44:03.425952 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77b1cc-a5d2-4494-af3b-ecf832ebfc55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:44:03.426258 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77b1cc-a5d2-4494-af3b-ecf832ebfc55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:44:03.427618 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77b1cc-a5d2-4494-af3b-ecf832ebfc55 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:44:03.438899 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 447/900] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:44:03.444633 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12277e6b-3038-44d2-95f2-d2f5f8a64453 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:44:03.541021 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12277e6b-3038-44d2-95f2-d2f5f8a64453 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:44:03.572401 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87afa421-cd68-4d96-a7e3-a1a7a485dacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:44:03.573219 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afa421-cd68-4d96-a7e3-a1a7a485dacc None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:44:03.573498 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afa421-cd68-4d96-a7e3-a1a7a485dacc None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:44:03.573769 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afa421-cd68-4d96-a7e3-a1a7a485dacc None admin] PATH_INFO: `/v3/users/placement` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:44:03.581477 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87afa421-cd68-4d96-a7e3-a1a7a485dacc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:44:03.582912 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87afa421-cd68-4d96-a7e3-a1a7a485dacc None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:44:03.597515 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-87afa421-cd68-4d96-a7e3-a1a7a485dacc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 30 20:44:03.597515 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:44:03.597515 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:44:03.597515 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:44:03.597515 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:44:03.597515 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:44:03.597515 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:44:03.597515 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:44:03.597515 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:44:03.597515 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:44:03.597515 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:44:03.597515 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:44:03.597515 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:44:03.597515 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:44:03.597515 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:44:03.597515 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:44:03.600749 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:44:03.600749 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:44:03.600749 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:44:03.600749 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:44:03.600749 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:44:03.600749 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:44:03.600749 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:44:03.600749 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:44:03.600749 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:44:03.600749 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:44:03.600749 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:44:03.600749 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:44:03.600749 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:44:03.600749 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:44:03.600749 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:44:03.600749 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:44:03.600749 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:44:03.600749 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:44:03.602002 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:44:03.602002 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:44:03.602002 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:44:03.602002 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:44:03.602002 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:44:03.602002 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:44:03.602002 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:44:03.602002 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:44:03.602002 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Apr 30 20:44:03.602002 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:44:03.602002 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 454/901] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:44:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:44:03.604706 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77b1cc-a5d2-4494-af3b-ecf832ebfc55 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:44:03.702271 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77b1cc-a5d2-4494-af3b-ecf832ebfc55 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:44:03.735267 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa174ba3-ddbe-43d3-bb51-acd056a47864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:44:03.736197 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa174ba3-ddbe-43d3-bb51-acd056a47864 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:44:03.736371 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa174ba3-ddbe-43d3-bb51-acd056a47864 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:44:03.736509 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa174ba3-ddbe-43d3-bb51-acd056a47864 None admin] PATH_INFO: `/v3/users` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:44:03.737344 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa174ba3-ddbe-43d3-bb51-acd056a47864 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:44:03.737648 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa174ba3-ddbe-43d3-bb51-acd056a47864 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:44:03.739061 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa174ba3-ddbe-43d3-bb51-acd056a47864 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:44:03.756148 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 448/902] 10.222.0.26 () {56 vars in 1143 bytes} [Sat Apr 30 20:44:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:44:03.762023 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87afa421-cd68-4d96-a7e3-a1a7a485dacc None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:44:03.866887 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87afa421-cd68-4d96-a7e3-a1a7a485dacc None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:44:03.903807 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87bcfb-11bb-4393-83bd-1c8f88ab53d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:44:03.904508 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87bcfb-11bb-4393-83bd-1c8f88ab53d5 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:44:03.904798 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87bcfb-11bb-4393-83bd-1c8f88ab53d5 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:44:03.905104 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87bcfb-11bb-4393-83bd-1c8f88ab53d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:44:03.972693 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87bcfb-11bb-4393-83bd-1c8f88ab53d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:44:03.974442 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87bcfb-11bb-4393-83bd-1c8f88ab53d5 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:44:04.073883 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 455/903] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Apr 30 20:44:03 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 30 20:44:04.079557 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa174ba3-ddbe-43d3-bb51-acd056a47864 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:44:04.175870 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa174ba3-ddbe-43d3-bb51-acd056a47864 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:44:04.207919 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e6fa2-b426-4f06-bcd4-9149196a51eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:44:04.208706 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e6fa2-b426-4f06-bcd4-9149196a51eb None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:44:04.209017 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e6fa2-b426-4f06-bcd4-9149196a51eb None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:44:04.209292 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e6fa2-b426-4f06-bcd4-9149196a51eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:44:04.219646 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e6fa2-b426-4f06-bcd4-9149196a51eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:44:04.221168 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e6fa2-b426-4f06-bcd4-9149196a51eb None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:44:04.239078 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-416e6fa2-b426-4f06-bcd4-9149196a51eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:44:04.239078 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:44:04.239078 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:44:04.239078 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:44:04.239078 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:44:04.239078 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:44:04.239078 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:44:04.239078 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:44:04.239078 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:44:04.239078 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:44:04.239078 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:44:04.239078 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:44:04.239078 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:44:04.239078 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:44:04.239078 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:44:04.240098 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:44:04.240098 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:44:04.240098 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:44:04.240098 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:44:04.240098 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:44:04.240098 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:44:04.240098 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:44:04.240098 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:44:04.240098 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:44:04.240098 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:44:04.240098 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:44:04.240098 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:44:04.240098 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:44:04.240098 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:44:04.240098 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:44:04.240098 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:44:04.240098 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:44:04.241100 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:44:04.241100 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:44:04.241100 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:44:04.241100 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:44:04.241100 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 449/904] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:44:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:44:04.245892 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87bcfb-11bb-4393-83bd-1c8f88ab53d5 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:44:04.340929 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87bcfb-11bb-4393-83bd-1c8f88ab53d5 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:44:04.373765 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7358767-8fe0-4eef-885c-c8aabf494884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:44:04.374409 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7358767-8fe0-4eef-885c-c8aabf494884 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:44:04.374687 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7358767-8fe0-4eef-885c-c8aabf494884 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:44:04.374958 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7358767-8fe0-4eef-885c-c8aabf494884 None admin] PATH_INFO: `/v3/domains` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:44:04.375684 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7358767-8fe0-4eef-885c-c8aabf494884 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:44:04.375985 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7358767-8fe0-4eef-885c-c8aabf494884 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:44:04.377412 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7358767-8fe0-4eef-885c-c8aabf494884 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:44:04.388584 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 456/905] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Apr 30 20:44:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:44:04.394429 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e6fa2-b426-4f06-bcd4-9149196a51eb None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:44:04.490318 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e6fa2-b426-4f06-bcd4-9149196a51eb None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:44:04.523497 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc943d-664d-4652-b7ec-851a41e9d195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:44:04.524277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc943d-664d-4652-b7ec-851a41e9d195 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:44:04.524564 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc943d-664d-4652-b7ec-851a41e9d195 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:44:04.524839 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc943d-664d-4652-b7ec-851a41e9d195 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:44:04.531461 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc943d-664d-4652-b7ec-851a41e9d195 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:44:04.533024 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc943d-664d-4652-b7ec-851a41e9d195 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:44:04.546932 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application [None req-43fc943d-664d-4652-b7ec-851a41e9d195 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:44:04.546932 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:44:04.546932 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:44:04.546932 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:44:04.546932 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:44:04.546932 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:44:04.546932 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:44:04.546932 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:44:04.546932 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:44:04.546932 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:44:04.546932 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:44:04.546932 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:44:04.546932 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:44:04.546932 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:44:04.546932 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:44:04.548000 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:44:04.548000 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:44:04.548000 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:44:04.548000 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:44:04.548000 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:44:04.548000 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:44:04.548000 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:44:04.548000 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:44:04.548000 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application with Lock( Apr 30 20:44:04.548000 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:44:04.548000 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:44:04.548000 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:44:04.548000 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:44:04.548000 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:44:04.548000 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:44:04.548000 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:44:04.548000 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:44:04.549135 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:44:04.549135 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:44:04.549135 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:44:04.549135 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:44:04.549135 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:44:04.549135 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:44:04.549135 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:44:04.549135 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: ERROR keystone.server.flask.application Apr 30 20:44:04.549135 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 450/906] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Apr 30 20:44:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:44:04.554013 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7358767-8fe0-4eef-885c-c8aabf494884 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:44:04.649300 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7358767-8fe0-4eef-885c-c8aabf494884 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:44:04.682146 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6f70f-21cf-4066-887a-7efc1185e17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:44:04.682783 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6f70f-21cf-4066-887a-7efc1185e17c None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:44:04.683060 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6f70f-21cf-4066-887a-7efc1185e17c None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:44:04.683334 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6f70f-21cf-4066-887a-7efc1185e17c None admin] PATH_INFO: `/v3/projects` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:44:04.684096 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6f70f-21cf-4066-887a-7efc1185e17c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:44:04.684397 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6f70f-21cf-4066-887a-7efc1185e17c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:44:04.686059 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6f70f-21cf-4066-887a-7efc1185e17c None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:44:04.697750 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 457/907] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Apr 30 20:44:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:44:04.703908 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc943d-664d-4652-b7ec-851a41e9d195 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:44:04.798801 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc943d-664d-4652-b7ec-851a41e9d195 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:44:04.831257 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90b696-d5ff-45bc-9b4b-36dfbb208709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:44:04.831952 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90b696-d5ff-45bc-9b4b-36dfbb208709 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:44:04.832230 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90b696-d5ff-45bc-9b4b-36dfbb208709 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:44:04.832496 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90b696-d5ff-45bc-9b4b-36dfbb208709 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:44:04.833338 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90b696-d5ff-45bc-9b4b-36dfbb208709 None admin] RBAC: Adding query filter params (role.id=31b3f11a82cd4cd2823e88aa0e931323, scope.project.id=45ddbc3ac9ff421598cbe53e1252d289, user.id=b6caa91b08d14b598502bfa806c90ebd) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:44:04.833647 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90b696-d5ff-45bc-9b4b-36dfbb208709 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:44:04.835069 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90b696-d5ff-45bc-9b4b-36dfbb208709 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:44:04.840729 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 451/908] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Apr 30 20:44:04 2022] GET /identity/v3/role_assignments?user.id=b6caa91b08d14b598502bfa806c90ebd&scope.project.id=45ddbc3ac9ff421598cbe53e1252d289&role.id=31b3f11a82cd4cd2823e88aa0e931323 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:44:07.142534 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0989c-7dd2-4754-9bdf-e058d919f59a None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:44:07.143049 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0989c-7dd2-4754-9bdf-e058d919f59a None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:44:07.143049 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0989c-7dd2-4754-9bdf-e058d919f59a None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:44:07.144504 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 458/909] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:44:07.150216 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3750bc3-62a0-491e-b14c-97b6419cadea None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:44:07.150697 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3750bc3-62a0-491e-b14c-97b6419cadea None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:44:07.150784 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3750bc3-62a0-491e-b14c-97b6419cadea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:44:07.168793 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-c3750bc3-62a0-491e-b14c-97b6419cadea None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:44:07.170887 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-c3750bc3-62a0-491e-b14c-97b6419cadea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:44:07.246806 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 452/910] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:44:07 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:44:07.270755 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0989c-7dd2-4754-9bdf-e058d919f59a None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:44:07.373941 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0989c-7dd2-4754-9bdf-e058d919f59a None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:44:07.408259 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9405df6-a5d0-4a00-85ff-4f25d3da0d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:44:07.409063 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9405df6-a5d0-4a00-85ff-4f25d3da0d6c None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:44:07.409349 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9405df6-a5d0-4a00-85ff-4f25d3da0d6c None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:44:07.409620 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9405df6-a5d0-4a00-85ff-4f25d3da0d6c None admin] PATH_INFO: `/v3/services/placement` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:44:07.410258 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9405df6-a5d0-4a00-85ff-4f25d3da0d6c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:44:07.411678 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9405df6-a5d0-4a00-85ff-4f25d3da0d6c None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:44:07.423911 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-b9405df6-a5d0-4a00-85ff-4f25d3da0d6c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 30 20:44:07.423911 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:44:07.423911 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:44:07.423911 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:44:07.423911 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:44:07.423911 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:44:07.423911 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:44:07.423911 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:44:07.423911 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Apr 30 20:44:07.423911 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:44:07.423911 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:44:07.423911 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:44:07.423911 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:44:07.423911 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:44:07.423911 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:44:07.423911 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:44:07.423911 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:44:07.424949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:44:07.424949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:44:07.424949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:44:07.424949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:44:07.424949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:44:07.424949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:44:07.424949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:44:07.424949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:44:07.424949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:44:07.424949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:44:07.424949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:44:07.424949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:44:07.424949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:44:07.424949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:44:07.424949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:44:07.424949 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:44:07.426347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:44:07.426347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:44:07.426347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:44:07.426347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:44:07.426347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:44:07.426347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:44:07.426347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:44:07.426347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:44:07.426347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:44:07.426347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:44:07.426347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:44:07.426347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:44:07.426347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Apr 30 20:44:07.426347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:44:07.426347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 459/911] 10.222.0.26 () {56 vars in 1117 bytes} [Sat Apr 30 20:44:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:44:07.431235 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3750bc3-62a0-491e-b14c-97b6419cadea None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:44:07.528525 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3750bc3-62a0-491e-b14c-97b6419cadea None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:44:07.560721 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dbd0d7-cf92-40bd-81fa-fe2ae3123b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:44:07.561403 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbd0d7-cf92-40bd-81fa-fe2ae3123b4e None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:44:07.561682 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbd0d7-cf92-40bd-81fa-fe2ae3123b4e None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:44:07.561952 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbd0d7-cf92-40bd-81fa-fe2ae3123b4e None admin] PATH_INFO: `/v3/services` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:44:07.562637 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dbd0d7-cf92-40bd-81fa-fe2ae3123b4e None admin] RBAC: Adding query filter params (name=placement) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:44:07.562939 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dbd0d7-cf92-40bd-81fa-fe2ae3123b4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:44:07.564289 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dbd0d7-cf92-40bd-81fa-fe2ae3123b4e None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:44:07.568982 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 453/912] 10.222.0.26 () {56 vars in 1116 bytes} [Sat Apr 30 20:44:07 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:44:07.574721 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9405df6-a5d0-4a00-85ff-4f25d3da0d6c None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:44:07.672101 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9405df6-a5d0-4a00-85ff-4f25d3da0d6c None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:44:07.703966 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947cc11-5c87-4d47-b03c-edb92e10b88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:44:07.704616 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947cc11-5c87-4d47-b03c-edb92e10b88d None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:44:07.704931 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947cc11-5c87-4d47-b03c-edb92e10b88d None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:44:07.705207 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947cc11-5c87-4d47-b03c-edb92e10b88d None admin] PATH_INFO: `/v3/services` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:44:07.705907 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f947cc11-5c87-4d47-b03c-edb92e10b88d None admin] RBAC: Adding query filter params (type=placement) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:44:07.706246 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f947cc11-5c87-4d47-b03c-edb92e10b88d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:44:07.707623 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f947cc11-5c87-4d47-b03c-edb92e10b88d None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:44:07.711950 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 460/913] 10.222.0.26 () {56 vars in 1116 bytes} [Sat Apr 30 20:44:07 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:44:09.982199 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5966626-5016-48fe-9279-3a4cd89d75a6 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:44:09.982690 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5966626-5016-48fe-9279-3a4cd89d75a6 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:44:09.982690 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5966626-5016-48fe-9279-3a4cd89d75a6 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:44:09.984093 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 454/914] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:44:09.989206 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0828c-25b2-48f6-8b4d-aa459585a137 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:44:09.989622 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0828c-25b2-48f6-8b4d-aa459585a137 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:44:09.989768 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0828c-25b2-48f6-8b4d-aa459585a137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:44:10.006735 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-b6f0828c-25b2-48f6-8b4d-aa459585a137 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:44:10.007904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-b6f0828c-25b2-48f6-8b4d-aa459585a137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:44:10.071686 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 461/915] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:44:09 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:44:10.097016 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5966626-5016-48fe-9279-3a4cd89d75a6 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:44:10.196722 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5966626-5016-48fe-9279-3a4cd89d75a6 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:44:10.229879 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78dfcc-57cb-4aba-9457-cf2dac2cd845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:44:10.230523 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78dfcc-57cb-4aba-9457-cf2dac2cd845 None admin] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:44:10.230800 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78dfcc-57cb-4aba-9457-cf2dac2cd845 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:44:10.231072 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78dfcc-57cb-4aba-9457-cf2dac2cd845 None admin] PATH_INFO: `/v3/services` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:44:10.231802 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78dfcc-57cb-4aba-9457-cf2dac2cd845 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:44:10.233188 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78dfcc-57cb-4aba-9457-cf2dac2cd845 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:44:10.356246 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 455/916] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Apr 30 20:44:10 2022] POST /identity/v3/services => generated 246 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:44:12.717077 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665733c-4a0e-40a2-8f8a-4a6fcd3e25f8 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:44:12.717626 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665733c-4a0e-40a2-8f8a-4a6fcd3e25f8 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:44:12.717626 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665733c-4a0e-40a2-8f8a-4a6fcd3e25f8 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:44:12.719112 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 462/917] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:44:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:44:12.724704 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db3a48-8e9e-4df6-a21b-8c481e9e2a0b None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:44:12.725157 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db3a48-8e9e-4df6-a21b-8c481e9e2a0b None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:44:12.725289 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db3a48-8e9e-4df6-a21b-8c481e9e2a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:44:12.741804 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-22db3a48-8e9e-4df6-a21b-8c481e9e2a0b None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:44:12.742968 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-22db3a48-8e9e-4df6-a21b-8c481e9e2a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:44:12.814573 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 456/918] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:44:12 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:44:12.838307 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665733c-4a0e-40a2-8f8a-4a6fcd3e25f8 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:44:12.935815 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665733c-4a0e-40a2-8f8a-4a6fcd3e25f8 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:44:12.968896 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72a7ea-173b-487f-b693-88bb2c42af78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:44:12.969657 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72a7ea-173b-487f-b693-88bb2c42af78 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:44:12.969943 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72a7ea-173b-487f-b693-88bb2c42af78 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:44:12.970220 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72a7ea-173b-487f-b693-88bb2c42af78 None admin] PATH_INFO: `/v3/services/placement` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:44:12.970858 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf72a7ea-173b-487f-b693-88bb2c42af78 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:44:12.972222 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf72a7ea-173b-487f-b693-88bb2c42af78 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:44:12.983954 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-bf72a7ea-173b-487f-b693-88bb2c42af78 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 30 20:44:12.983954 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:44:12.983954 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:44:12.983954 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:44:12.983954 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:44:12.983954 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:44:12.983954 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:44:12.983954 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:44:12.983954 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Apr 30 20:44:12.983954 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:44:12.983954 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:44:12.983954 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:44:12.983954 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:44:12.983954 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:44:12.983954 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:44:12.983954 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:44:12.983954 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:44:12.990958 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:44:12.990958 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:44:12.990958 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:44:12.990958 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:44:12.990958 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:44:12.990958 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:44:12.990958 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:44:12.990958 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:44:12.990958 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:44:12.990958 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:44:12.990958 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:44:12.990958 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:44:12.990958 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:44:12.990958 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:44:12.990958 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:44:12.990958 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:44:12.991990 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:44:12.991990 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:44:12.991990 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:44:12.991990 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:44:12.991990 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:44:12.991990 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:44:12.991990 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:44:12.991990 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:44:12.991990 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:44:12.991990 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:44:12.991990 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:44:12.991990 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:44:12.991990 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Apr 30 20:44:12.991990 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:44:12.991990 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 463/919] 10.222.0.26 () {56 vars in 1117 bytes} [Sat Apr 30 20:44:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:44:12.993022 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db3a48-8e9e-4df6-a21b-8c481e9e2a0b None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:44:13.084466 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db3a48-8e9e-4df6-a21b-8c481e9e2a0b None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:44:13.116848 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a2331-b864-4230-abc9-a4a9f9a3ab18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:44:13.117522 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a2331-b864-4230-abc9-a4a9f9a3ab18 None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:44:13.117805 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a2331-b864-4230-abc9-a4a9f9a3ab18 None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:44:13.118079 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a2331-b864-4230-abc9-a4a9f9a3ab18 None admin] PATH_INFO: `/v3/services` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:44:13.118768 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a2331-b864-4230-abc9-a4a9f9a3ab18 None admin] RBAC: Adding query filter params (name=placement) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:44:13.119071 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a2331-b864-4230-abc9-a4a9f9a3ab18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:44:13.120428 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a2331-b864-4230-abc9-a4a9f9a3ab18 None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:44:13.125862 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 457/920] 10.222.0.26 () {56 vars in 1116 bytes} [Sat Apr 30 20:44:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:44:13.131798 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72a7ea-173b-487f-b693-88bb2c42af78 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:44:13.229211 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72a7ea-173b-487f-b693-88bb2c42af78 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:44:13.262272 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6cda7-a618-4de1-a79b-e97235de0c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:44:13.263558 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6cda7-a618-4de1-a79b-e97235de0c77 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:44:13.263840 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6cda7-a618-4de1-a79b-e97235de0c77 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:44:13.264111 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6cda7-a618-4de1-a79b-e97235de0c77 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:44:13.264885 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee6cda7-a618-4de1-a79b-e97235de0c77 None admin] RBAC: Adding query filter params (interface=public, service_id=693580c02db041bf8b73fdb49bd8172d, region_id=RegionOne) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:44:13.265227 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee6cda7-a618-4de1-a79b-e97235de0c77 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:44:13.266611 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee6cda7-a618-4de1-a79b-e97235de0c77 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:44:13.271639 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 464/921] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Apr 30 20:44:13 2022] GET /identity/v3/endpoints?service_id=693580c02db041bf8b73fdb49bd8172d&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:44:13.277421 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a2331-b864-4230-abc9-a4a9f9a3ab18 None admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:44:13.371057 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a2331-b864-4230-abc9-a4a9f9a3ab18 None admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:44:13.403004 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12038271-a748-4b7b-a5b0-94fb5bc2940b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:44:13.403706 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12038271-a748-4b7b-a5b0-94fb5bc2940b None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:44:13.404018 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12038271-a748-4b7b-a5b0-94fb5bc2940b None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:44:13.404360 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12038271-a748-4b7b-a5b0-94fb5bc2940b None admin] PATH_INFO: `/v3/services` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:44:13.405055 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12038271-a748-4b7b-a5b0-94fb5bc2940b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:44:13.406402 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12038271-a748-4b7b-a5b0-94fb5bc2940b None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:44:13.412710 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 458/922] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Apr 30 20:44:13 2022] GET /identity/v3/services => generated 1962 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 20:44:15.693176 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95408a0a-0596-4600-8f4f-4ec7a6493f06 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:44:15.693705 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95408a0a-0596-4600-8f4f-4ec7a6493f06 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:44:15.693801 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95408a0a-0596-4600-8f4f-4ec7a6493f06 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:44:15.695081 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 465/923] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:44:15.700828 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecbec9-e0db-47ed-aa49-2a67a10c0137 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:44:15.701454 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecbec9-e0db-47ed-aa49-2a67a10c0137 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:44:15.701454 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecbec9-e0db-47ed-aa49-2a67a10c0137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:44:15.718382 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-a7ecbec9-e0db-47ed-aa49-2a67a10c0137 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:44:15.719552 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-a7ecbec9-e0db-47ed-aa49-2a67a10c0137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:44:15.783763 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 459/924] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:44:15 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:44:15.807410 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95408a0a-0596-4600-8f4f-4ec7a6493f06 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:44:15.905795 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95408a0a-0596-4600-8f4f-4ec7a6493f06 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:44:15.937855 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a416d-181f-4382-8292-e3ba55009b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:44:15.938666 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a416d-181f-4382-8292-e3ba55009b61 None admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:44:15.938943 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a416d-181f-4382-8292-e3ba55009b61 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:44:15.939215 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a416d-181f-4382-8292-e3ba55009b61 None admin] PATH_INFO: `/v3/services/placement` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:44:15.939887 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a416d-181f-4382-8292-e3ba55009b61 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:44:15.941272 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a416d-181f-4382-8292-e3ba55009b61 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:44:15.953432 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application [None req-cd9a416d-181f-4382-8292-e3ba55009b61 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 30 20:44:15.953432 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:44:15.953432 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:44:15.953432 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:44:15.953432 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:44:15.953432 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:44:15.953432 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:44:15.953432 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:44:15.953432 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Apr 30 20:44:15.953432 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:44:15.953432 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:44:15.953432 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:44:15.953432 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:44:15.953432 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:44:15.953432 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:44:15.953432 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:44:15.953432 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:44:15.954580 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:44:15.954580 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:44:15.954580 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:44:15.954580 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:44:15.954580 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:44:15.954580 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:44:15.954580 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:44:15.954580 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:44:15.954580 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:44:15.954580 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:44:15.954580 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:44:15.954580 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:44:15.954580 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:44:15.954580 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:44:15.954580 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:44:15.954580 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:44:15.955792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:44:15.955792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application with Lock( Apr 30 20:44:15.955792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:44:15.955792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:44:15.955792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:44:15.955792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:44:15.955792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:44:15.955792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:44:15.955792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:44:15.955792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:44:15.955792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:44:15.955792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:44:15.955792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Apr 30 20:44:15.955792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: ERROR keystone.server.flask.application Apr 30 20:44:15.955792 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 466/925] 10.222.0.26 () {56 vars in 1117 bytes} [Sat Apr 30 20:44:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:44:15.960525 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ecbec9-e0db-47ed-aa49-2a67a10c0137 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:44:16.053716 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ecbec9-e0db-47ed-aa49-2a67a10c0137 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:44:16.086656 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1058b87-9fa7-4371-b723-947e5521ae8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:44:16.087345 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1058b87-9fa7-4371-b723-947e5521ae8f None admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:44:16.087626 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1058b87-9fa7-4371-b723-947e5521ae8f None admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:44:16.087900 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1058b87-9fa7-4371-b723-947e5521ae8f None admin] PATH_INFO: `/v3/services` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:44:16.088625 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1058b87-9fa7-4371-b723-947e5521ae8f None admin] RBAC: Adding query filter params (name=placement) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:44:16.088956 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1058b87-9fa7-4371-b723-947e5521ae8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:44:16.090313 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1058b87-9fa7-4371-b723-947e5521ae8f None admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:44:16.095388 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 460/926] 10.222.0.26 () {56 vars in 1116 bytes} [Sat Apr 30 20:44:15 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:44:16.101495 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a416d-181f-4382-8292-e3ba55009b61 None admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:44:16.196652 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a416d-181f-4382-8292-e3ba55009b61 None admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:44:16.230451 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeaf156-da5f-406f-a194-b515355dec26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:44:16.231038 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaf156-da5f-406f-a194-b515355dec26 None admin] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:44:16.231345 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaf156-da5f-406f-a194-b515355dec26 None admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:44:16.231604 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaf156-da5f-406f-a194-b515355dec26 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:44:16.232341 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeaf156-da5f-406f-a194-b515355dec26 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:44:16.234191 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeaf156-da5f-406f-a194-b515355dec26 None admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:44:16.304106 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 467/927] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Apr 30 20:44:16 2022] POST /identity/v3/endpoints => generated 331 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:50:59.346364 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b5348-417c-4de3-a22d-672f95857c79 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:59.346939 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b5348-417c-4de3-a22d-672f95857c79 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:59.348855 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b5348-417c-4de3-a22d-672f95857c79 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:59.351155 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 461/928] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:50:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:50:59.356480 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6dacc8-20c1-4438-aa09-65c8c4bbcd90 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:59.356996 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6dacc8-20c1-4438-aa09-65c8c4bbcd90 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:59.357093 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6dacc8-20c1-4438-aa09-65c8c4bbcd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:59.445891 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-3b6dacc8-20c1-4438-aa09-65c8c4bbcd90 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:50:59.447356 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-3b6dacc8-20c1-4438-aa09-65c8c4bbcd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:50:59.557795 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 468/929] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:50:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:50:59.608952 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc581c6-33bb-402d-8ec2-5e6e7d8a5cde None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:59.609771 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc581c6-33bb-402d-8ec2-5e6e7d8a5cde None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:59.610056 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc581c6-33bb-402d-8ec2-5e6e7d8a5cde None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:59.612018 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 462/930] 10.222.0.26 () {54 vars in 964 bytes} [Sat Apr 30 20:50:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:50:59.618424 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f9b2a-17b3-498a-abdb-cbb97dfbd55e None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:59.618663 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f9b2a-17b3-498a-abdb-cbb97dfbd55e None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:59.618943 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f9b2a-17b3-498a-abdb-cbb97dfbd55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:59.680390 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-371f9b2a-17b3-498a-abdb-cbb97dfbd55e None None] MFA Rules not processed for user `9918e808c77e4017a64c96ad24164b37`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:50:59.681511 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-371f9b2a-17b3-498a-abdb-cbb97dfbd55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:50:59.765525 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 469/931] 10.222.0.26 () {58 vars in 1061 bytes} [Sat Apr 30 20:50:59 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:50:59.776567 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc581c6-33bb-402d-8ec2-5e6e7d8a5cde None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:59.789639 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc581c6-33bb-402d-8ec2-5e6e7d8a5cde None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:59.793637 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872c718-eb48-4137-9a63-920c11771773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:59.794478 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872c718-eb48-4137-9a63-920c11771773 service neutron] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:59.794878 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872c718-eb48-4137-9a63-920c11771773 service neutron] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:59.795268 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872c718-eb48-4137-9a63-920c11771773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:59.805837 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872c718-eb48-4137-9a63-920c11771773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:59.807626 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872c718-eb48-4137-9a63-920c11771773 service neutron] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:59.829178 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 463/932] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:50:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 20:51:02.429413 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d0d9d-3693-46b9-ad19-b0f537f61455 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:02.430002 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d0d9d-3693-46b9-ad19-b0f537f61455 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:02.430002 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d0d9d-3693-46b9-ad19-b0f537f61455 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:02.431310 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 470/933] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:51:02.436656 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4875b2b-2279-4592-9bb3-bc065fa6321b None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:02.437099 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4875b2b-2279-4592-9bb3-bc065fa6321b None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:02.437249 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4875b2b-2279-4592-9bb3-bc065fa6321b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:02.454638 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-a4875b2b-2279-4592-9bb3-bc065fa6321b None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:51:02.455812 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-a4875b2b-2279-4592-9bb3-bc065fa6321b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:51:02.463979 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 464/934] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:51:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:51:02.503775 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d0d9d-3693-46b9-ad19-b0f537f61455 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:51:02.514210 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d0d9d-3693-46b9-ad19-b0f537f61455 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:51:02.517687 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44431500-4eed-49ed-ac20-c359222ba7d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:51:02.518320 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44431500-4eed-49ed-ac20-c359222ba7d0 service neutron] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:02.518605 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44431500-4eed-49ed-ac20-c359222ba7d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:02.519514 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44431500-4eed-49ed-ac20-c359222ba7d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:02.528285 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44431500-4eed-49ed-ac20-c359222ba7d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:51:02.529780 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44431500-4eed-49ed-ac20-c359222ba7d0 service neutron] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:51:02.539858 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 471/935] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:51:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:51:05.399597 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231f8bc-6849-4ca5-9721-c2718fd0ca14 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:05.400190 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231f8bc-6849-4ca5-9721-c2718fd0ca14 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:05.400190 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231f8bc-6849-4ca5-9721-c2718fd0ca14 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:05.401583 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 465/936] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:51:05.406947 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f76c0a-9380-4b4c-9714-bd79156e8f85 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:05.407369 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f76c0a-9380-4b4c-9714-bd79156e8f85 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:05.407510 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f76c0a-9380-4b4c-9714-bd79156e8f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:05.481621 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-b4f76c0a-9380-4b4c-9714-bd79156e8f85 None None] MFA Rules not processed for user `cecfe9bf486c4fba9525c86babed4c07`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:51:05.483699 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-b4f76c0a-9380-4b4c-9714-bd79156e8f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:51:05.634584 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 472/937] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:51:05 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:51:05.674538 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231f8bc-6849-4ca5-9721-c2718fd0ca14 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:51:05.686798 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231f8bc-6849-4ca5-9721-c2718fd0ca14 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:51:05.690435 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6527007-7085-4abd-a2d5-25a16501cd8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:51:05.691457 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6527007-7085-4abd-a2d5-25a16501cd8e service neutron] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:05.691847 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6527007-7085-4abd-a2d5-25a16501cd8e service neutron] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:05.692249 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6527007-7085-4abd-a2d5-25a16501cd8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:05.702159 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6527007-7085-4abd-a2d5-25a16501cd8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:51:05.703991 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6527007-7085-4abd-a2d5-25a16501cd8e service neutron] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:51:05.715960 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 466/938] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:51:05 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:51:08.952474 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d1f16-220b-4c14-8b2b-deb4b12c9cdc None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:08.953029 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d1f16-220b-4c14-8b2b-deb4b12c9cdc None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:08.953142 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d1f16-220b-4c14-8b2b-deb4b12c9cdc None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:08.954401 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 473/939] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:51:08.959698 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43073e26-efa0-4d6d-9128-66f74f31ea96 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:08.960119 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43073e26-efa0-4d6d-9128-66f74f31ea96 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:08.960251 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43073e26-efa0-4d6d-9128-66f74f31ea96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:08.977984 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-43073e26-efa0-4d6d-9128-66f74f31ea96 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:51:08.979147 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-43073e26-efa0-4d6d-9128-66f74f31ea96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:51:09.047425 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 467/940] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:51:08 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:51:09.103052 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789d0bc-e723-49d8-8ce5-822f134c67c9 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:09.103336 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789d0bc-e723-49d8-8ce5-822f134c67c9 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:09.103613 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789d0bc-e723-49d8-8ce5-822f134c67c9 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:09.104974 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 474/941] 10.222.0.26 () {54 vars in 964 bytes} [Sat Apr 30 20:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:51:09.110790 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916a295-3798-4444-af68-876fa08bb45c None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:09.111078 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916a295-3798-4444-af68-876fa08bb45c None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:09.111352 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916a295-3798-4444-af68-876fa08bb45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:09.129597 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-c916a295-3798-4444-af68-876fa08bb45c None None] MFA Rules not processed for user `9918e808c77e4017a64c96ad24164b37`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:51:09.130768 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-c916a295-3798-4444-af68-876fa08bb45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:51:09.136990 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 468/942] 10.222.0.26 () {58 vars in 1061 bytes} [Sat Apr 30 20:51:09 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:51:09.145601 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789d0bc-e723-49d8-8ce5-822f134c67c9 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:51:09.155704 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789d0bc-e723-49d8-8ce5-822f134c67c9 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:51:09.159596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ebc03-48d2-44c2-beba-71cbd8396bb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:51:09.160298 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ebc03-48d2-44c2-beba-71cbd8396bb7 service neutron] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:09.160573 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ebc03-48d2-44c2-beba-71cbd8396bb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:09.160838 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ebc03-48d2-44c2-beba-71cbd8396bb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:09.169335 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ebc03-48d2-44c2-beba-71cbd8396bb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:51:09.170766 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ebc03-48d2-44c2-beba-71cbd8396bb7 service neutron] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:51:09.180425 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 475/943] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:51:09 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:51:12.984008 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e8593-25f7-4152-b708-4d5758aab858 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:12.984558 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e8593-25f7-4152-b708-4d5758aab858 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:12.984558 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e8593-25f7-4152-b708-4d5758aab858 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:12.986111 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 469/944] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:51:12.991587 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6dfa04-e2bb-4c61-ab67-9297da4caf20 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:12.992024 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6dfa04-e2bb-4c61-ab67-9297da4caf20 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:12.992324 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6dfa04-e2bb-4c61-ab67-9297da4caf20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:13.010596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-7a6dfa04-e2bb-4c61-ab67-9297da4caf20 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:51:13.011782 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-7a6dfa04-e2bb-4c61-ab67-9297da4caf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:51:13.020424 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 476/945] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:51:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:51:13.057961 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e8593-25f7-4152-b708-4d5758aab858 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:51:13.069381 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e8593-25f7-4152-b708-4d5758aab858 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:51:13.072786 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0ed0d-84e8-41d9-8439-c2fb5ab486bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:51:13.073464 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0ed0d-84e8-41d9-8439-c2fb5ab486bf service neutron] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:13.073750 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0ed0d-84e8-41d9-8439-c2fb5ab486bf service neutron] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:13.074029 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0ed0d-84e8-41d9-8439-c2fb5ab486bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:13.083103 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0ed0d-84e8-41d9-8439-c2fb5ab486bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:51:13.084565 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0ed0d-84e8-41d9-8439-c2fb5ab486bf service neutron] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:51:13.094331 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 470/946] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:51:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 20:51:15.448791 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c4417-d095-4039-b024-a79cbf852873 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:15.449451 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c4417-d095-4039-b024-a79cbf852873 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:15.449451 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c4417-d095-4039-b024-a79cbf852873 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:15.450811 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 477/947] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:51:15.456674 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d52506-a759-4573-87a5-603d3495011c None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:15.457295 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d52506-a759-4573-87a5-603d3495011c None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:15.457708 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d52506-a759-4573-87a5-603d3495011c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:15.477260 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-40d52506-a759-4573-87a5-603d3495011c None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:51:15.478568 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-40d52506-a759-4573-87a5-603d3495011c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:51:15.486442 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 471/948] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:51:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:51:15.523954 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c4417-d095-4039-b024-a79cbf852873 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:51:15.535671 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c4417-d095-4039-b024-a79cbf852873 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:51:15.538715 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d8579-2ad7-489b-b1cc-2ef311d61582 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:51:15.539351 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d8579-2ad7-489b-b1cc-2ef311d61582 service neutron] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:15.539630 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d8579-2ad7-489b-b1cc-2ef311d61582 service neutron] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:15.539904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d8579-2ad7-489b-b1cc-2ef311d61582 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:15.549253 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8d8579-2ad7-489b-b1cc-2ef311d61582 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:51:15.553895 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8d8579-2ad7-489b-b1cc-2ef311d61582 service neutron] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:51:15.560221 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 478/949] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:51:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:51:17.920391 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f79f5b-e8ac-42c3-81fa-4b82351aae6a None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:17.920959 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f79f5b-e8ac-42c3-81fa-4b82351aae6a None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:17.921068 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f79f5b-e8ac-42c3-81fa-4b82351aae6a None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:17.922357 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 472/950] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:51:17.927668 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0975ba2-4c73-46e3-918d-ef1e7f8ac6ba None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:17.928093 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0975ba2-4c73-46e3-918d-ef1e7f8ac6ba None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:17.928341 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0975ba2-4c73-46e3-918d-ef1e7f8ac6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:17.946222 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-b0975ba2-4c73-46e3-918d-ef1e7f8ac6ba None None] MFA Rules not processed for user `cecfe9bf486c4fba9525c86babed4c07`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:51:17.947427 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-b0975ba2-4c73-46e3-918d-ef1e7f8ac6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:51:17.955375 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 479/951] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:51:17 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:51:17.994001 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f79f5b-e8ac-42c3-81fa-4b82351aae6a None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:51:18.005384 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f79f5b-e8ac-42c3-81fa-4b82351aae6a None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:51:18.008774 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352525a-9091-432e-a352-d7bbe82eaaad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:51:18.009501 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352525a-9091-432e-a352-d7bbe82eaaad service neutron] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:18.009783 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352525a-9091-432e-a352-d7bbe82eaaad service neutron] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:18.010057 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352525a-9091-432e-a352-d7bbe82eaaad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:18.019441 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c352525a-9091-432e-a352-d7bbe82eaaad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:51:18.020859 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c352525a-9091-432e-a352-d7bbe82eaaad service neutron] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:51:18.030535 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 473/952] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:51:17 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 20:51:20.768297 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c1455-8ff6-4c5c-a272-a6ad5ed517da None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:20.768823 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c1455-8ff6-4c5c-a272-a6ad5ed517da None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:20.768823 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c1455-8ff6-4c5c-a272-a6ad5ed517da None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:20.770298 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 480/953] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:51:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:51:20.775653 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c52822-a617-48aa-b1e1-53eb81f3d9f2 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:20.776071 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c52822-a617-48aa-b1e1-53eb81f3d9f2 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:20.776272 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c52822-a617-48aa-b1e1-53eb81f3d9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:20.794240 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-30c52822-a617-48aa-b1e1-53eb81f3d9f2 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:51:20.795427 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-30c52822-a617-48aa-b1e1-53eb81f3d9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:51:20.803086 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 474/954] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:51:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:51:20.839491 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c1455-8ff6-4c5c-a272-a6ad5ed517da None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:51:20.850813 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c1455-8ff6-4c5c-a272-a6ad5ed517da None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:51:20.860757 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41788cd5-d0d0-492c-a33e-829d06778047 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:51:20.860757 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41788cd5-d0d0-492c-a33e-829d06778047 service neutron] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:20.860757 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41788cd5-d0d0-492c-a33e-829d06778047 service neutron] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:20.860757 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41788cd5-d0d0-492c-a33e-829d06778047 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:20.864393 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41788cd5-d0d0-492c-a33e-829d06778047 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:51:20.865876 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41788cd5-d0d0-492c-a33e-829d06778047 service neutron] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:51:20.875498 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 481/955] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:51:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:51:23.231911 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0983d-b83a-40df-9af3-87ea690a5b44 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:23.232446 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0983d-b83a-40df-9af3-87ea690a5b44 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:23.232446 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0983d-b83a-40df-9af3-87ea690a5b44 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:23.236039 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 475/956] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:51:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:51:23.239654 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef6be8-b7a2-4255-abaf-fd2a4f65991f None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:23.240483 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef6be8-b7a2-4255-abaf-fd2a4f65991f None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:23.240997 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef6be8-b7a2-4255-abaf-fd2a4f65991f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:23.259797 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-77ef6be8-b7a2-4255-abaf-fd2a4f65991f None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:51:23.261004 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-77ef6be8-b7a2-4255-abaf-fd2a4f65991f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:51:23.269411 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 482/957] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:51:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:51:23.309279 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0983d-b83a-40df-9af3-87ea690a5b44 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:51:23.320474 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0983d-b83a-40df-9af3-87ea690a5b44 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:51:23.323941 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c113af-6ad2-4b88-9d50-62c57af84b45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:51:23.324579 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c113af-6ad2-4b88-9d50-62c57af84b45 service neutron] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:23.324859 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c113af-6ad2-4b88-9d50-62c57af84b45 service neutron] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:23.325166 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c113af-6ad2-4b88-9d50-62c57af84b45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:23.334729 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c113af-6ad2-4b88-9d50-62c57af84b45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:51:23.336415 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c113af-6ad2-4b88-9d50-62c57af84b45 service neutron] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:51:23.345619 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 476/958] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:51:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 20:51:26.263098 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d1a9b-4bcd-4eea-8398-0015f9e0fc81 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:26.263628 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d1a9b-4bcd-4eea-8398-0015f9e0fc81 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:26.263628 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d1a9b-4bcd-4eea-8398-0015f9e0fc81 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:26.265028 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 483/959] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:51:26.270467 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f60cf2-a3d5-4196-a347-5856c9be2824 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:26.270900 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f60cf2-a3d5-4196-a347-5856c9be2824 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:26.271025 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f60cf2-a3d5-4196-a347-5856c9be2824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:26.288675 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-15f60cf2-a3d5-4196-a347-5856c9be2824 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:51:26.289893 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-15f60cf2-a3d5-4196-a347-5856c9be2824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:51:26.297535 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 477/960] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:51:26 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 20:51:26.334208 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d1a9b-4bcd-4eea-8398-0015f9e0fc81 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:51:26.344817 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d1a9b-4bcd-4eea-8398-0015f9e0fc81 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:51:26.348871 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d5474-ef3b-4ccd-b2c6-493f28aca283 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:51:26.349522 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d5474-ef3b-4ccd-b2c6-493f28aca283 service neutron] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:26.349803 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d5474-ef3b-4ccd-b2c6-493f28aca283 service neutron] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:26.350075 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d5474-ef3b-4ccd-b2c6-493f28aca283 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:26.358641 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d5474-ef3b-4ccd-b2c6-493f28aca283 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:51:26.360072 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d5474-ef3b-4ccd-b2c6-493f28aca283 service neutron] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:51:26.369817 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 484/961] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:51:26 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:51:31.042493 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84610357-094c-4aab-8291-4027e8976715 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:31.043847 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84610357-094c-4aab-8291-4027e8976715 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:31.044124 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84610357-094c-4aab-8291-4027e8976715 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:31.045540 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 478/962] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:51:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:51:31.051604 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d081d-6e53-43e9-9c84-1a3cc3e58ede None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:31.052031 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d081d-6e53-43e9-9c84-1a3cc3e58ede None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:31.052157 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d081d-6e53-43e9-9c84-1a3cc3e58ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:31.071872 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-368d081d-6e53-43e9-9c84-1a3cc3e58ede None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:51:31.073206 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-368d081d-6e53-43e9-9c84-1a3cc3e58ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:51:31.081764 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 485/963] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:51:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:51:31.121500 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84610357-094c-4aab-8291-4027e8976715 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:51:31.132780 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84610357-094c-4aab-8291-4027e8976715 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:51:31.136314 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd63e13-553e-40fe-989c-ec5226e2f468 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:51:31.136973 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd63e13-553e-40fe-989c-ec5226e2f468 service neutron] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:31.137255 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd63e13-553e-40fe-989c-ec5226e2f468 service neutron] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:31.137530 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd63e13-553e-40fe-989c-ec5226e2f468 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:31.146517 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd63e13-553e-40fe-989c-ec5226e2f468 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:51:31.147879 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd63e13-553e-40fe-989c-ec5226e2f468 service neutron] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:51:31.157001 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 479/964] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:51:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:51:34.538988 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef172d2-b605-4561-a4ce-78d6e8c13a11 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:34.539574 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef172d2-b605-4561-a4ce-78d6e8c13a11 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:34.539574 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef172d2-b605-4561-a4ce-78d6e8c13a11 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:34.541070 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 486/965] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:51:34.546135 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ade1d-949a-43bb-bd2c-ec0b9d2fbd83 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:34.546578 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ade1d-949a-43bb-bd2c-ec0b9d2fbd83 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:34.546677 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ade1d-949a-43bb-bd2c-ec0b9d2fbd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:34.563903 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-682ade1d-949a-43bb-bd2c-ec0b9d2fbd83 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:51:34.568504 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-682ade1d-949a-43bb-bd2c-ec0b9d2fbd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:51:34.573545 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 480/966] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:51:34 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:51:34.611954 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef172d2-b605-4561-a4ce-78d6e8c13a11 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:51:34.622300 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef172d2-b605-4561-a4ce-78d6e8c13a11 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:51:34.625724 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85de5c-d727-4803-9911-b9d0dcb9c9e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:51:34.626375 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85de5c-d727-4803-9911-b9d0dcb9c9e6 service neutron] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:34.627568 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85de5c-d727-4803-9911-b9d0dcb9c9e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:34.627790 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85de5c-d727-4803-9911-b9d0dcb9c9e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:34.636458 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85de5c-d727-4803-9911-b9d0dcb9c9e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:51:34.637921 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85de5c-d727-4803-9911-b9d0dcb9c9e6 service neutron] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:51:34.647249 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 487/967] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:51:34 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:51:39.644439 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e17f4-6303-438b-b548-d1c25c7beec1 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:39.645023 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e17f4-6303-438b-b548-d1c25c7beec1 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:39.645023 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e17f4-6303-438b-b548-d1c25c7beec1 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:39.646379 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 481/968] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:51:39.651673 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffddc6-5546-479c-8d68-c585e82a397f None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:39.652065 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffddc6-5546-479c-8d68-c585e82a397f None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:39.652242 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffddc6-5546-479c-8d68-c585e82a397f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:39.670291 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-d4ffddc6-5546-479c-8d68-c585e82a397f None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:51:39.671522 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-d4ffddc6-5546-479c-8d68-c585e82a397f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:51:39.680445 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 488/969] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:51:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:51:39.719460 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e17f4-6303-438b-b548-d1c25c7beec1 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:51:39.730253 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e17f4-6303-438b-b548-d1c25c7beec1 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:51:39.733852 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44fe69-f85b-4413-ab3f-fa2a7c5ea834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:51:39.734582 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44fe69-f85b-4413-ab3f-fa2a7c5ea834 service neutron] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:39.734936 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44fe69-f85b-4413-ab3f-fa2a7c5ea834 service neutron] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:39.735282 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44fe69-f85b-4413-ab3f-fa2a7c5ea834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:39.745253 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44fe69-f85b-4413-ab3f-fa2a7c5ea834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:51:39.746721 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44fe69-f85b-4413-ab3f-fa2a7c5ea834 service neutron] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:51:39.756472 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 482/970] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:51:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:51:45.085771 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e369ae-da92-47f1-80d7-f129b427a72a None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:45.086878 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e369ae-da92-47f1-80d7-f129b427a72a None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:45.087384 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e369ae-da92-47f1-80d7-f129b427a72a None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:45.089543 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 489/971] 10.222.0.26 () {54 vars in 921 bytes} [Sat Apr 30 20:51:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:51:45.094116 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705ba3c-c797-4694-a0d4-922eadbe423b None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:45.094940 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705ba3c-c797-4694-a0d4-922eadbe423b None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:45.095436 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705ba3c-c797-4694-a0d4-922eadbe423b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:45.144819 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-8705ba3c-c797-4694-a0d4-922eadbe423b None None] MFA Rules not processed for user `b6caa91b08d14b598502bfa806c90ebd`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:51:45.146358 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-8705ba3c-c797-4694-a0d4-922eadbe423b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:51:45.223032 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 483/972] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Apr 30 20:51:45 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:51:49.618845 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca557d3d-26e4-4577-b50f-23d896dc4242 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:49.619359 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca557d3d-26e4-4577-b50f-23d896dc4242 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:49.619440 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca557d3d-26e4-4577-b50f-23d896dc4242 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:49.620764 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 490/973] 10.222.0.26 () {54 vars in 921 bytes} [Sat Apr 30 20:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:51:49.627211 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee7884-234e-4a06-a776-707cebc151f7 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:49.627652 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee7884-234e-4a06-a776-707cebc151f7 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:49.627754 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee7884-234e-4a06-a776-707cebc151f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:49.648225 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-06ee7884-234e-4a06-a776-707cebc151f7 None None] MFA Rules not processed for user `b6caa91b08d14b598502bfa806c90ebd`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:51:49.649557 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-06ee7884-234e-4a06-a776-707cebc151f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:51:49.658097 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 484/974] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Apr 30 20:51:49 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:51:51.256420 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d59d9-4564-4388-8d33-c0a164647818 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:51.257026 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d59d9-4564-4388-8d33-c0a164647818 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:51.257026 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d59d9-4564-4388-8d33-c0a164647818 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:51.258246 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 491/975] 10.222.0.26 () {54 vars in 921 bytes} [Sat Apr 30 20:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:51:51.263511 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d03c15-a74c-47a6-9554-fe862bf3cfa4 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:51.263929 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d03c15-a74c-47a6-9554-fe862bf3cfa4 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:51.264234 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d03c15-a74c-47a6-9554-fe862bf3cfa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:51.282765 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-44d03c15-a74c-47a6-9554-fe862bf3cfa4 None None] MFA Rules not processed for user `b6caa91b08d14b598502bfa806c90ebd`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:51:51.284001 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-44d03c15-a74c-47a6-9554-fe862bf3cfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:51:51.292710 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 485/976] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Apr 30 20:51:51 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 20:51:55.331723 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2edc9-43cc-4b4b-ba18-bdd3ca698733 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:55.332251 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2edc9-43cc-4b4b-ba18-bdd3ca698733 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:55.332251 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2edc9-43cc-4b4b-ba18-bdd3ca698733 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:55.333532 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 492/977] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:51:55.338920 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf51401-3c4c-43a1-a2be-2992531b29ea None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:55.339334 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf51401-3c4c-43a1-a2be-2992531b29ea None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:55.339473 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf51401-3c4c-43a1-a2be-2992531b29ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:55.357479 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-dcf51401-3c4c-43a1-a2be-2992531b29ea None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:51:55.358655 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-dcf51401-3c4c-43a1-a2be-2992531b29ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:51:55.367177 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 486/978] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:51:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:51:55.416179 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358dba05-e7ca-40ab-836a-d3be8a633f91 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:55.416461 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358dba05-e7ca-40ab-836a-d3be8a633f91 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:55.416936 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358dba05-e7ca-40ab-836a-d3be8a633f91 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:55.418426 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 493/979] 10.222.0.26 () {54 vars in 960 bytes} [Sat Apr 30 20:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:51:55.424182 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef005ed7-6e16-4ca1-8f42-4d8bcc4e8e32 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:55.424591 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef005ed7-6e16-4ca1-8f42-4d8bcc4e8e32 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:55.425014 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef005ed7-6e16-4ca1-8f42-4d8bcc4e8e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:55.473309 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-ef005ed7-6e16-4ca1-8f42-4d8bcc4e8e32 None None] MFA Rules not processed for user `2aee3a7a6b4b4d489993c131f3ae2048`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:51:55.474609 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-ef005ed7-6e16-4ca1-8f42-4d8bcc4e8e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:51:55.548354 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 487/980] 10.222.0.26 () {58 vars in 1057 bytes} [Sat Apr 30 20:51:55 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:51:55.556292 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358dba05-e7ca-40ab-836a-d3be8a633f91 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:51:55.570297 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358dba05-e7ca-40ab-836a-d3be8a633f91 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:51:55.575264 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e03bc-b4be-444a-b0c3-5e100a4c7bc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aee3a7a6b4b4d489993c131f3ae2048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:51:55.575895 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e03bc-b4be-444a-b0c3-5e100a4c7bc3 service nova] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:55.576177 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e03bc-b4be-444a-b0c3-5e100a4c7bc3 service nova] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:55.576451 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e03bc-b4be-444a-b0c3-5e100a4c7bc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:55.585682 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e03bc-b4be-444a-b0c3-5e100a4c7bc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:51:55.587248 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e03bc-b4be-444a-b0c3-5e100a4c7bc3 service nova] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:51:55.598938 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 494/981] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:51:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:51:58.165605 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7194412-ab22-42ef-a7c4-9e6ec1ff809c None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:58.166103 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7194412-ab22-42ef-a7c4-9e6ec1ff809c None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:58.166103 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7194412-ab22-42ef-a7c4-9e6ec1ff809c None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:58.167432 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 488/982] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:51:58.172752 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6fd28-e727-451f-93d4-c4a03576521d None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:58.173561 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6fd28-e727-451f-93d4-c4a03576521d None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:58.173848 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6fd28-e727-451f-93d4-c4a03576521d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:58.191395 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-b4e6fd28-e727-451f-93d4-c4a03576521d None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:51:58.192596 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-b4e6fd28-e727-451f-93d4-c4a03576521d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:51:58.200474 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 495/983] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:51:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:51:58.245365 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7194412-ab22-42ef-a7c4-9e6ec1ff809c None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:51:58.261782 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7194412-ab22-42ef-a7c4-9e6ec1ff809c None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:51:58.267046 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae54026-cf88-4625-af2a-4aa85a784a7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aee3a7a6b4b4d489993c131f3ae2048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:51:58.267865 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae54026-cf88-4625-af2a-4aa85a784a7b service nova] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:58.268147 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae54026-cf88-4625-af2a-4aa85a784a7b service nova] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:58.268422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae54026-cf88-4625-af2a-4aa85a784a7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:58.277049 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae54026-cf88-4625-af2a-4aa85a784a7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:51:58.278629 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae54026-cf88-4625-af2a-4aa85a784a7b service nova] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:51:58.288130 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 489/984] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:51:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:52:01.061836 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9248fa4-d6d3-4853-a517-9bedf3b5ee89 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:01.062233 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9248fa4-d6d3-4853-a517-9bedf3b5ee89 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:01.062400 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9248fa4-d6d3-4853-a517-9bedf3b5ee89 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:01.063891 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 496/985] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:01.069312 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca49bae-7af5-4194-b709-2ad6b8198723 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:01.069740 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca49bae-7af5-4194-b709-2ad6b8198723 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:01.069842 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca49bae-7af5-4194-b709-2ad6b8198723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:01.088384 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-6ca49bae-7af5-4194-b709-2ad6b8198723 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:01.089601 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-6ca49bae-7af5-4194-b709-2ad6b8198723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:01.098199 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 490/986] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:52:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:52:01.144236 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad016ac-c549-41e9-a3ed-a50728082fee None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:01.144524 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad016ac-c549-41e9-a3ed-a50728082fee None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:01.144898 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad016ac-c549-41e9-a3ed-a50728082fee None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:01.146259 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 497/987] 10.222.0.26 () {54 vars in 960 bytes} [Sat Apr 30 20:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:01.151542 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401a3e3-1083-44cd-9e56-f18da2203eda None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:01.151833 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401a3e3-1083-44cd-9e56-f18da2203eda None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:01.152114 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401a3e3-1083-44cd-9e56-f18da2203eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:01.170340 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-c401a3e3-1083-44cd-9e56-f18da2203eda None None] MFA Rules not processed for user `2aee3a7a6b4b4d489993c131f3ae2048`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:01.171519 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-c401a3e3-1083-44cd-9e56-f18da2203eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:01.179974 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 491/988] 10.222.0.26 () {58 vars in 1057 bytes} [Sat Apr 30 20:52:01 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:52:01.187412 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad016ac-c549-41e9-a3ed-a50728082fee None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:01.200322 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad016ac-c549-41e9-a3ed-a50728082fee None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:01.205671 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909082d-7707-48da-b746-54764d155115 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aee3a7a6b4b4d489993c131f3ae2048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:01.206285 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909082d-7707-48da-b746-54764d155115 service nova] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:01.206564 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909082d-7707-48da-b746-54764d155115 service nova] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:01.206837 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909082d-7707-48da-b746-54764d155115 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:01.214941 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909082d-7707-48da-b746-54764d155115 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:01.216510 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909082d-7707-48da-b746-54764d155115 service nova] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:01.226396 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 498/989] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:52:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 20:52:03.835157 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf328781-8503-45c4-a067-d24854a7faf3 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:03.836178 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf328781-8503-45c4-a067-d24854a7faf3 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:03.836691 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf328781-8503-45c4-a067-d24854a7faf3 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:03.842249 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 492/990] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:52:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:03.845239 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da331687-e502-4a39-b12f-1ca79bcb8a4a None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:03.846230 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da331687-e502-4a39-b12f-1ca79bcb8a4a None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:03.846732 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da331687-e502-4a39-b12f-1ca79bcb8a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:03.866689 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-da331687-e502-4a39-b12f-1ca79bcb8a4a None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:03.874229 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-da331687-e502-4a39-b12f-1ca79bcb8a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:03.886981 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 499/991] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:52:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:52:03.928639 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf328781-8503-45c4-a067-d24854a7faf3 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:03.950088 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf328781-8503-45c4-a067-d24854a7faf3 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:03.956688 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a466ef-3bca-4846-bdd2-29be74e6322e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aee3a7a6b4b4d489993c131f3ae2048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:03.957764 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a466ef-3bca-4846-bdd2-29be74e6322e service nova] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:03.958263 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a466ef-3bca-4846-bdd2-29be74e6322e service nova] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:03.958745 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a466ef-3bca-4846-bdd2-29be74e6322e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:03.969715 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a466ef-3bca-4846-bdd2-29be74e6322e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:03.973721 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a466ef-3bca-4846-bdd2-29be74e6322e service nova] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:03.986458 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 493/992] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:52:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:52:05.505120 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2cea3-3eb4-44de-b2be-ef32bd9faf51 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:05.505680 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2cea3-3eb4-44de-b2be-ef32bd9faf51 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:05.505680 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2cea3-3eb4-44de-b2be-ef32bd9faf51 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:05.513063 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961a94c-b765-4e4e-ba40-5aa2b6705718 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:05.514039 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961a94c-b765-4e4e-ba40-5aa2b6705718 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:05.514493 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961a94c-b765-4e4e-ba40-5aa2b6705718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:05.517613 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 500/993] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:52:05 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:05.536117 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-8961a94c-b765-4e4e-ba40-5aa2b6705718 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:05.537789 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-8961a94c-b765-4e4e-ba40-5aa2b6705718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:05.557580 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 494/994] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:52:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:52:05.836314 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89d0a2-f1ab-4c3d-a59e-1a0cfafcea52 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:05.836601 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89d0a2-f1ab-4c3d-a59e-1a0cfafcea52 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:05.837101 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89d0a2-f1ab-4c3d-a59e-1a0cfafcea52 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:05.838475 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 501/995] 10.222.0.26 () {54 vars in 963 bytes} [Sat Apr 30 20:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:05.844860 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffcdde-51b0-4944-8fe5-dba2b3c52ba5 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:05.845265 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffcdde-51b0-4944-8fe5-dba2b3c52ba5 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:05.845459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffcdde-51b0-4944-8fe5-dba2b3c52ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:05.894564 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-56ffcdde-51b0-4944-8fe5-dba2b3c52ba5 None None] MFA Rules not processed for user `ec3374e008274f9eb4476b9f6a528fa6`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:05.895753 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-56ffcdde-51b0-4944-8fe5-dba2b3c52ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:05.956216 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 495/996] 10.222.0.26 () {58 vars in 1060 bytes} [Sat Apr 30 20:52:05 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:52:05.970208 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89d0a2-f1ab-4c3d-a59e-1a0cfafcea52 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:05.981388 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89d0a2-f1ab-4c3d-a59e-1a0cfafcea52 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:05.985284 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61149fb-863f-4f82-ad32-244262b37f52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec3374e008274f9eb4476b9f6a528fa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:05.986189 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61149fb-863f-4f82-ad32-244262b37f52 service cinder] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:05.986616 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61149fb-863f-4f82-ad32-244262b37f52 service cinder] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:05.987034 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61149fb-863f-4f82-ad32-244262b37f52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:05.996625 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61149fb-863f-4f82-ad32-244262b37f52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:06.006071 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61149fb-863f-4f82-ad32-244262b37f52 service cinder] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:06.022931 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 502/997] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:52:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:52:06.821999 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d9a96-dfb5-4e7a-addb-abd433fc1459 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:06.822499 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d9a96-dfb5-4e7a-addb-abd433fc1459 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:06.822593 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d9a96-dfb5-4e7a-addb-abd433fc1459 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:06.823989 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 496/998] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:06.829464 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cc0fa-96fe-4d63-8ae3-6acf6996e0cc None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:06.829911 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cc0fa-96fe-4d63-8ae3-6acf6996e0cc None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:06.830011 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cc0fa-96fe-4d63-8ae3-6acf6996e0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:06.853494 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-c60cc0fa-96fe-4d63-8ae3-6acf6996e0cc None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:06.853494 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-c60cc0fa-96fe-4d63-8ae3-6acf6996e0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:06.859890 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 503/999] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:52:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:52:06.913809 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d9a96-dfb5-4e7a-addb-abd433fc1459 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:06.929882 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d9a96-dfb5-4e7a-addb-abd433fc1459 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:06.936749 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a57908-a82d-46f6-a3b6-c2a880241195 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aee3a7a6b4b4d489993c131f3ae2048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:06.937408 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a57908-a82d-46f6-a3b6-c2a880241195 service nova] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:06.938224 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a57908-a82d-46f6-a3b6-c2a880241195 service nova] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:06.940114 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a57908-a82d-46f6-a3b6-c2a880241195 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:06.949258 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a57908-a82d-46f6-a3b6-c2a880241195 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:06.951022 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a57908-a82d-46f6-a3b6-c2a880241195 service nova] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:06.961855 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 497/1000] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:52:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:52:09.496765 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bc224-2cb9-45f9-99c0-5123a083ab21 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:09.497319 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bc224-2cb9-45f9-99c0-5123a083ab21 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:09.497319 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bc224-2cb9-45f9-99c0-5123a083ab21 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:09.498675 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 504/1001] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:09.504204 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791e259-a96c-4ef2-8e58-3577b40c2291 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:09.504596 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791e259-a96c-4ef2-8e58-3577b40c2291 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:09.505004 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791e259-a96c-4ef2-8e58-3577b40c2291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:09.523209 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-d791e259-a96c-4ef2-8e58-3577b40c2291 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:09.524392 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-d791e259-a96c-4ef2-8e58-3577b40c2291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:09.533579 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 498/1002] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:52:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:52:09.577577 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bc224-2cb9-45f9-99c0-5123a083ab21 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:09.591520 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bc224-2cb9-45f9-99c0-5123a083ab21 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:09.597020 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749e881-36b7-448c-9e9e-ce78ba2f0920 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aee3a7a6b4b4d489993c131f3ae2048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:09.597675 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749e881-36b7-448c-9e9e-ce78ba2f0920 service nova] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:09.597960 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749e881-36b7-448c-9e9e-ce78ba2f0920 service nova] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:09.598237 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749e881-36b7-448c-9e9e-ce78ba2f0920 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:09.606120 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749e881-36b7-448c-9e9e-ce78ba2f0920 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:09.607693 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749e881-36b7-448c-9e9e-ce78ba2f0920 service nova] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:09.616932 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 505/1003] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:52:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:52:12.179668 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1416b-5c1b-40ec-ae37-eae6ef64ada8 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:12.180845 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1416b-5c1b-40ec-ae37-eae6ef64ada8 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:12.181379 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1416b-5c1b-40ec-ae37-eae6ef64ada8 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:12.183268 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 499/1004] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:52:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:12.189135 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5535c6-e24a-4537-bb07-0bdfdd0b0498 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:12.189637 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5535c6-e24a-4537-bb07-0bdfdd0b0498 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:12.189739 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5535c6-e24a-4537-bb07-0bdfdd0b0498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:12.207444 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-1d5535c6-e24a-4537-bb07-0bdfdd0b0498 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:12.208618 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-1d5535c6-e24a-4537-bb07-0bdfdd0b0498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:12.216517 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 506/1005] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:52:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:52:12.259530 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1416b-5c1b-40ec-ae37-eae6ef64ada8 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:12.273146 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1416b-5c1b-40ec-ae37-eae6ef64ada8 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:12.278013 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e1d9b-1ba8-42e4-84df-865c7f15ffdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aee3a7a6b4b4d489993c131f3ae2048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:12.278650 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e1d9b-1ba8-42e4-84df-865c7f15ffdd service nova] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:12.278930 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e1d9b-1ba8-42e4-84df-865c7f15ffdd service nova] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:12.279204 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e1d9b-1ba8-42e4-84df-865c7f15ffdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:12.287816 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e1d9b-1ba8-42e4-84df-865c7f15ffdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:12.289422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e1d9b-1ba8-42e4-84df-865c7f15ffdd service nova] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:12.299536 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 500/1006] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:52:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:52:14.642459 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d96ef-6222-4112-9846-e94b0ccecb67 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:14.643046 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d96ef-6222-4112-9846-e94b0ccecb67 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:14.643253 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d96ef-6222-4112-9846-e94b0ccecb67 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:14.645251 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 507/1007] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:52:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:14.650580 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715ec14-2747-498a-9ead-3d7a1353c560 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:14.650990 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715ec14-2747-498a-9ead-3d7a1353c560 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:14.651274 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715ec14-2747-498a-9ead-3d7a1353c560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:14.669265 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-a715ec14-2747-498a-9ead-3d7a1353c560 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:14.670450 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-a715ec14-2747-498a-9ead-3d7a1353c560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:14.679133 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 501/1008] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:52:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:52:14.728156 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d96ef-6222-4112-9846-e94b0ccecb67 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:14.742071 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d96ef-6222-4112-9846-e94b0ccecb67 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:14.747226 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01719454-200d-4b5d-89e6-0e99c9e92198 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aee3a7a6b4b4d489993c131f3ae2048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:14.747880 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01719454-200d-4b5d-89e6-0e99c9e92198 service nova] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:14.748175 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01719454-200d-4b5d-89e6-0e99c9e92198 service nova] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:14.748465 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01719454-200d-4b5d-89e6-0e99c9e92198 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:14.757494 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01719454-200d-4b5d-89e6-0e99c9e92198 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:14.759082 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01719454-200d-4b5d-89e6-0e99c9e92198 service nova] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:14.769105 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 508/1009] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:52:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:52:17.929285 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03c85a-c3a6-42e0-855b-cfafd08a1a05 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:17.930303 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03c85a-c3a6-42e0-855b-cfafd08a1a05 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:17.930303 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03c85a-c3a6-42e0-855b-cfafd08a1a05 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:17.931828 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 502/1010] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:52:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:17.937720 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a5b87-7be5-4400-96e1-8aa939ee7f84 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:17.938466 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a5b87-7be5-4400-96e1-8aa939ee7f84 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:17.938466 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a5b87-7be5-4400-96e1-8aa939ee7f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:17.960180 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-202a5b87-7be5-4400-96e1-8aa939ee7f84 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:17.961456 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-202a5b87-7be5-4400-96e1-8aa939ee7f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:17.969712 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 509/1011] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:52:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:52:18.018755 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03c85a-c3a6-42e0-855b-cfafd08a1a05 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:18.034282 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03c85a-c3a6-42e0-855b-cfafd08a1a05 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:18.039521 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5d50d-7aac-47b4-9f10-1925a3556c2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aee3a7a6b4b4d489993c131f3ae2048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:18.040187 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5d50d-7aac-47b4-9f10-1925a3556c2b service nova] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:18.040469 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5d50d-7aac-47b4-9f10-1925a3556c2b service nova] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:18.040767 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5d50d-7aac-47b4-9f10-1925a3556c2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:18.049817 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5d50d-7aac-47b4-9f10-1925a3556c2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:18.051425 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5d50d-7aac-47b4-9f10-1925a3556c2b service nova] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:18.062666 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 503/1012] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:52:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 20:52:21.323263 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d05c6d-4b72-4245-b625-80398c8fd37c None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:21.323896 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d05c6d-4b72-4245-b625-80398c8fd37c None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:21.323896 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d05c6d-4b72-4245-b625-80398c8fd37c None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:21.325203 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 510/1013] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:21.331420 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715bd2c-0d60-4e8f-9164-1fbc29b752a0 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:21.331924 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715bd2c-0d60-4e8f-9164-1fbc29b752a0 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:21.332019 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715bd2c-0d60-4e8f-9164-1fbc29b752a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:21.354105 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-7715bd2c-0d60-4e8f-9164-1fbc29b752a0 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:21.355290 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-7715bd2c-0d60-4e8f-9164-1fbc29b752a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:21.363089 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 504/1014] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:52:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 20:52:21.407664 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d05c6d-4b72-4245-b625-80398c8fd37c None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:21.420801 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d05c6d-4b72-4245-b625-80398c8fd37c None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:21.425696 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d7466-5685-4658-80e5-3c9b341a19c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aee3a7a6b4b4d489993c131f3ae2048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:21.426319 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d7466-5685-4658-80e5-3c9b341a19c0 service nova] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:21.426600 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d7466-5685-4658-80e5-3c9b341a19c0 service nova] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:21.426874 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d7466-5685-4658-80e5-3c9b341a19c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:21.434702 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d7466-5685-4658-80e5-3c9b341a19c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:21.436281 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d7466-5685-4658-80e5-3c9b341a19c0 service nova] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:21.445453 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 511/1015] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:52:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:52:22.381514 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3b9ee-daa0-41d6-99fd-d735f327061c None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:22.382137 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3b9ee-daa0-41d6-99fd-d735f327061c None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:22.382137 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3b9ee-daa0-41d6-99fd-d735f327061c None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:22.383493 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 505/1016] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:22.388818 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04628778-3927-4466-808d-e532b342ba60 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:22.389290 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04628778-3927-4466-808d-e532b342ba60 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:22.389444 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04628778-3927-4466-808d-e532b342ba60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:22.407598 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-04628778-3927-4466-808d-e532b342ba60 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:22.408780 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-04628778-3927-4466-808d-e532b342ba60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:22.416533 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 512/1017] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:52:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:52:22.473495 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5424e1f-b78d-48fa-ae2d-32e1eecf5796 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:22.473787 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5424e1f-b78d-48fa-ae2d-32e1eecf5796 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:22.474064 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5424e1f-b78d-48fa-ae2d-32e1eecf5796 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:22.475587 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 506/1018] 10.222.0.26 () {54 vars in 962 bytes} [Sat Apr 30 20:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:22.480424 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a10928-259c-4d66-8081-ccdb8a26c491 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:22.480717 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a10928-259c-4d66-8081-ccdb8a26c491 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:22.481028 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a10928-259c-4d66-8081-ccdb8a26c491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:22.528518 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-68a10928-259c-4d66-8081-ccdb8a26c491 None None] MFA Rules not processed for user `43ed44bbd52047cbbcab1bc72d650b8e`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:22.529760 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-68a10928-259c-4d66-8081-ccdb8a26c491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:22.589204 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 513/1019] 10.222.0.26 () {58 vars in 1059 bytes} [Sat Apr 30 20:52:22 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:52:22.597219 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5424e1f-b78d-48fa-ae2d-32e1eecf5796 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:22.607399 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5424e1f-b78d-48fa-ae2d-32e1eecf5796 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:22.611782 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb26f0-3d3c-442f-ac11-eed8d84f630a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ed44bbd52047cbbcab1bc72d650b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:22.612471 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb26f0-3d3c-442f-ac11-eed8d84f630a service glance] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:22.612754 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb26f0-3d3c-442f-ac11-eed8d84f630a service glance] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:22.613095 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb26f0-3d3c-442f-ac11-eed8d84f630a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:22.622042 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb26f0-3d3c-442f-ac11-eed8d84f630a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:22.623471 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb26f0-3d3c-442f-ac11-eed8d84f630a service glance] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:22.633227 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 507/1020] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:52:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:52:23.939454 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9c49b-f160-452d-851f-99c2293fed00 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:23.939454 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9c49b-f160-452d-851f-99c2293fed00 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:23.939454 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9c49b-f160-452d-851f-99c2293fed00 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:23.939454 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 514/1021] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:23.944508 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cf4e9-80a9-409d-9137-f5765899bf44 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:23.944993 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cf4e9-80a9-409d-9137-f5765899bf44 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:23.945098 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cf4e9-80a9-409d-9137-f5765899bf44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:23.971458 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-e98cf4e9-80a9-409d-9137-f5765899bf44 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:23.972781 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-e98cf4e9-80a9-409d-9137-f5765899bf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:23.981264 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 508/1022] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:52:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:52:24.028593 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9c49b-f160-452d-851f-99c2293fed00 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:24.049396 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9c49b-f160-452d-851f-99c2293fed00 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:24.056950 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4463aaf-b2fc-444d-aa4a-7ba76dff8460 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aee3a7a6b4b4d489993c131f3ae2048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:24.057708 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4463aaf-b2fc-444d-aa4a-7ba76dff8460 service nova] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:24.058096 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4463aaf-b2fc-444d-aa4a-7ba76dff8460 service nova] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:24.058470 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4463aaf-b2fc-444d-aa4a-7ba76dff8460 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:24.069632 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4463aaf-b2fc-444d-aa4a-7ba76dff8460 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:24.071169 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4463aaf-b2fc-444d-aa4a-7ba76dff8460 service nova] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:24.081880 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 515/1023] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:52:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:52:26.859722 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b3431-df26-443f-8c05-bbd8fd99e757 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:26.860204 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b3431-df26-443f-8c05-bbd8fd99e757 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:26.860320 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b3431-df26-443f-8c05-bbd8fd99e757 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:26.861709 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 509/1024] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:52:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:26.867044 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a20000-4643-4c59-8daa-d2cdb2f51b2f None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:26.867475 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a20000-4643-4c59-8daa-d2cdb2f51b2f None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:26.867580 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a20000-4643-4c59-8daa-d2cdb2f51b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:26.887931 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-f1a20000-4643-4c59-8daa-d2cdb2f51b2f None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:26.890950 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-f1a20000-4643-4c59-8daa-d2cdb2f51b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:26.897690 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 516/1025] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:52:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:52:26.943560 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b3431-df26-443f-8c05-bbd8fd99e757 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:26.957028 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b3431-df26-443f-8c05-bbd8fd99e757 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:26.962732 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70402ad1-b199-4e4a-9ba5-4a3947d1e745 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aee3a7a6b4b4d489993c131f3ae2048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:26.963381 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70402ad1-b199-4e4a-9ba5-4a3947d1e745 service nova] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:26.963656 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70402ad1-b199-4e4a-9ba5-4a3947d1e745 service nova] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:26.963927 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70402ad1-b199-4e4a-9ba5-4a3947d1e745 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:26.973275 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70402ad1-b199-4e4a-9ba5-4a3947d1e745 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:26.974853 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70402ad1-b199-4e4a-9ba5-4a3947d1e745 service nova] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:26.985340 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 510/1026] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:52:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:52:38.464478 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101532f-a203-4665-bf52-dfa6f776d376 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:38.465112 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101532f-a203-4665-bf52-dfa6f776d376 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:38.465229 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101532f-a203-4665-bf52-dfa6f776d376 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:38.466566 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 517/1027] 10.222.0.26 () {54 vars in 918 bytes} [Sat Apr 30 20:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:38.471584 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ec613-e991-490d-a425-26e82c2ecbaf None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:38.472046 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ec613-e991-490d-a425-26e82c2ecbaf None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:38.472158 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ec613-e991-490d-a425-26e82c2ecbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:38.489429 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-979ec613-e991-490d-a425-26e82c2ecbaf None None] MFA Rules not processed for user `b6caa91b08d14b598502bfa806c90ebd`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:38.490629 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-979ec613-e991-490d-a425-26e82c2ecbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:38.499621 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 511/1028] 10.222.0.26 () {58 vars in 1015 bytes} [Sat Apr 30 20:52:38 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:52:38.513509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b005a4-e1f3-4bcd-96c5-e17805441c72 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:38.514340 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b005a4-e1f3-4bcd-96c5-e17805441c72 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:38.514624 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b005a4-e1f3-4bcd-96c5-e17805441c72 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:38.515970 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 518/1029] 10.222.0.26 () {54 vars in 918 bytes} [Sat Apr 30 20:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:38.520645 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb0621-e80e-48aa-ae11-79d57ae97c1a None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:38.520960 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb0621-e80e-48aa-ae11-79d57ae97c1a None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:38.521244 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb0621-e80e-48aa-ae11-79d57ae97c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:38.539374 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-9dcb0621-e80e-48aa-ae11-79d57ae97c1a None None] MFA Rules not processed for user `2aee3a7a6b4b4d489993c131f3ae2048`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:38.540548 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-9dcb0621-e80e-48aa-ae11-79d57ae97c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:38.549479 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 512/1030] 10.222.0.26 () {58 vars in 1015 bytes} [Sat Apr 30 20:52:38 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:52:41.327243 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f752b3-a941-4024-87f2-702c5fedca53 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:41.327821 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f752b3-a941-4024-87f2-702c5fedca53 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:41.327936 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f752b3-a941-4024-87f2-702c5fedca53 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:41.329302 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 519/1031] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 30 20:52:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:41.334940 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920c1d5-caeb-45d2-a1ea-ee852355883a None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:41.335371 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920c1d5-caeb-45d2-a1ea-ee852355883a None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:41.335481 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920c1d5-caeb-45d2-a1ea-ee852355883a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:41.352821 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-b920c1d5-caeb-45d2-a1ea-ee852355883a None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:41.354035 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-b920c1d5-caeb-45d2-a1ea-ee852355883a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:41.361701 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 513/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 30 20:52:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:52:41.404167 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f752b3-a941-4024-87f2-702c5fedca53 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:41.417532 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f752b3-a941-4024-87f2-702c5fedca53 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:41.422902 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46aac6-dd09-48eb-9e87-5fd4bbca7eac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aee3a7a6b4b4d489993c131f3ae2048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:41.423529 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46aac6-dd09-48eb-9e87-5fd4bbca7eac service nova] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:41.423807 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46aac6-dd09-48eb-9e87-5fd4bbca7eac service nova] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:41.424081 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46aac6-dd09-48eb-9e87-5fd4bbca7eac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:41.432049 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46aac6-dd09-48eb-9e87-5fd4bbca7eac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:41.433706 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46aac6-dd09-48eb-9e87-5fd4bbca7eac service nova] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:41.443411 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 520/1033] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:52:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:52:42.830778 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d583a62-8fac-436d-ba8a-68c9ff48709d None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:42.831296 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d583a62-8fac-436d-ba8a-68c9ff48709d None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:42.831409 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d583a62-8fac-436d-ba8a-68c9ff48709d None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:42.832993 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 514/1034] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 30 20:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:42.838005 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd6a09-c65e-4bbb-a5e7-4d9b94a46cd4 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:42.838391 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd6a09-c65e-4bbb-a5e7-4d9b94a46cd4 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:42.838549 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd6a09-c65e-4bbb-a5e7-4d9b94a46cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:42.856244 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-89fd6a09-c65e-4bbb-a5e7-4d9b94a46cd4 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:42.858083 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-89fd6a09-c65e-4bbb-a5e7-4d9b94a46cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:42.865755 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 521/1035] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 30 20:52:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:52:43.077197 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d583a62-8fac-436d-ba8a-68c9ff48709d None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:43.090539 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d583a62-8fac-436d-ba8a-68c9ff48709d None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:43.096146 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b600759-c976-4f44-b3af-6f324df839a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aee3a7a6b4b4d489993c131f3ae2048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:43.096770 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b600759-c976-4f44-b3af-6f324df839a2 service nova] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:43.097086 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b600759-c976-4f44-b3af-6f324df839a2 service nova] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:43.097362 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b600759-c976-4f44-b3af-6f324df839a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:43.105269 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b600759-c976-4f44-b3af-6f324df839a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:43.106836 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b600759-c976-4f44-b3af-6f324df839a2 service nova] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:43.116295 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 515/1036] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:52:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:52:44.448603 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28f9bc-4fdf-4bfb-81f3-75eec25dc27b None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:44.449226 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28f9bc-4fdf-4bfb-81f3-75eec25dc27b None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:44.449226 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28f9bc-4fdf-4bfb-81f3-75eec25dc27b None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:44.450530 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 522/1037] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 30 20:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:44.455586 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101aed17-8da2-4d37-851c-9ae5beb8262e None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:44.456001 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101aed17-8da2-4d37-851c-9ae5beb8262e None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:44.456142 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101aed17-8da2-4d37-851c-9ae5beb8262e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:44.474254 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-101aed17-8da2-4d37-851c-9ae5beb8262e None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:44.475416 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-101aed17-8da2-4d37-851c-9ae5beb8262e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:44.483629 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 516/1038] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 30 20:52:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:52:44.639713 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28f9bc-4fdf-4bfb-81f3-75eec25dc27b None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:44.652830 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28f9bc-4fdf-4bfb-81f3-75eec25dc27b None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:44.658612 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598222f-80eb-4c05-9fed-fcc8e6ba1678 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aee3a7a6b4b4d489993c131f3ae2048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:44.659231 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598222f-80eb-4c05-9fed-fcc8e6ba1678 service nova] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:44.659509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598222f-80eb-4c05-9fed-fcc8e6ba1678 service nova] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:44.659780 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598222f-80eb-4c05-9fed-fcc8e6ba1678 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:44.667969 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598222f-80eb-4c05-9fed-fcc8e6ba1678 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:44.669620 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598222f-80eb-4c05-9fed-fcc8e6ba1678 service nova] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:44.678947 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 523/1039] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:52:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:52:45.977463 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d242bf4-b557-4283-b434-4fafe67152f1 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:45.978106 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d242bf4-b557-4283-b434-4fafe67152f1 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:45.978106 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d242bf4-b557-4283-b434-4fafe67152f1 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:45.979366 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 517/1040] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 30 20:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:45.984809 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf547bf-1181-4d0c-91e5-2dca93249eaa None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:45.985273 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf547bf-1181-4d0c-91e5-2dca93249eaa None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:45.985417 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf547bf-1181-4d0c-91e5-2dca93249eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:46.002966 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-edf547bf-1181-4d0c-91e5-2dca93249eaa None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:46.004158 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-edf547bf-1181-4d0c-91e5-2dca93249eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:46.011847 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 524/1041] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 30 20:52:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:52:46.163161 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d242bf4-b557-4283-b434-4fafe67152f1 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:46.176124 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d242bf4-b557-4283-b434-4fafe67152f1 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:46.180956 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defeeb63-8480-47c7-b160-f3221800eae7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aee3a7a6b4b4d489993c131f3ae2048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:46.181580 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defeeb63-8480-47c7-b160-f3221800eae7 service nova] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:46.181857 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defeeb63-8480-47c7-b160-f3221800eae7 service nova] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:46.182129 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defeeb63-8480-47c7-b160-f3221800eae7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:46.190135 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defeeb63-8480-47c7-b160-f3221800eae7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:46.191684 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defeeb63-8480-47c7-b160-f3221800eae7 service nova] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:46.201277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 518/1042] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:52:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:52:47.490243 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61cb96c-a4b8-4be4-bf7c-3735b4a87150 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:47.490807 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61cb96c-a4b8-4be4-bf7c-3735b4a87150 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:47.490807 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61cb96c-a4b8-4be4-bf7c-3735b4a87150 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:47.492140 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 525/1043] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 30 20:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:47.497208 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ada9a-e263-4597-a8a9-ebf6b314c3e3 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:47.498190 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ada9a-e263-4597-a8a9-ebf6b314c3e3 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:47.498603 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ada9a-e263-4597-a8a9-ebf6b314c3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:47.515870 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-ee4ada9a-e263-4597-a8a9-ebf6b314c3e3 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:47.517081 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-ee4ada9a-e263-4597-a8a9-ebf6b314c3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:47.524547 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 519/1044] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 30 20:52:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:52:47.678472 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61cb96c-a4b8-4be4-bf7c-3735b4a87150 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:47.691905 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61cb96c-a4b8-4be4-bf7c-3735b4a87150 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:47.696709 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d3f57-236f-46b6-8144-1e25c6648c15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aee3a7a6b4b4d489993c131f3ae2048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:47.697368 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d3f57-236f-46b6-8144-1e25c6648c15 service nova] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:47.697685 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d3f57-236f-46b6-8144-1e25c6648c15 service nova] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:47.697957 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d3f57-236f-46b6-8144-1e25c6648c15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:47.705923 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d3f57-236f-46b6-8144-1e25c6648c15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:47.707762 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d3f57-236f-46b6-8144-1e25c6648c15 service nova] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:47.717681 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 526/1045] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:52:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:52:49.198483 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cb910-ca39-48ee-8e18-2c0d6b52743a None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:49.198988 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cb910-ca39-48ee-8e18-2c0d6b52743a None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:49.198988 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cb910-ca39-48ee-8e18-2c0d6b52743a None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:49.200311 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 520/1046] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 30 20:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:49.205493 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad894c26-6a01-4d30-ae12-91ed83a1db24 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:49.205919 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad894c26-6a01-4d30-ae12-91ed83a1db24 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:49.206055 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad894c26-6a01-4d30-ae12-91ed83a1db24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:49.224481 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-ad894c26-6a01-4d30-ae12-91ed83a1db24 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:49.225772 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-ad894c26-6a01-4d30-ae12-91ed83a1db24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:49.234165 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 527/1047] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 30 20:52:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:52:49.385687 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3cb910-ca39-48ee-8e18-2c0d6b52743a None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:49.398824 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3cb910-ca39-48ee-8e18-2c0d6b52743a None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:49.403633 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aed937-4bcf-45e1-94eb-82c97a4f9b20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aee3a7a6b4b4d489993c131f3ae2048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:49.404285 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aed937-4bcf-45e1-94eb-82c97a4f9b20 service nova] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:49.405242 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aed937-4bcf-45e1-94eb-82c97a4f9b20 service nova] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:49.405541 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aed937-4bcf-45e1-94eb-82c97a4f9b20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:49.413513 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aed937-4bcf-45e1-94eb-82c97a4f9b20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:49.415086 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aed937-4bcf-45e1-94eb-82c97a4f9b20 service nova] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:49.425193 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 521/1048] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:52:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:52:50.805072 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a9853-ea07-41d3-8716-55ee3bc71a77 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:50.805632 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a9853-ea07-41d3-8716-55ee3bc71a77 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:50.805632 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a9853-ea07-41d3-8716-55ee3bc71a77 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:50.806970 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 528/1049] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 30 20:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:50.812306 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139e8f7-3db7-438a-bc2c-c0b651c26d1e None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:50.812782 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139e8f7-3db7-438a-bc2c-c0b651c26d1e None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:50.812875 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139e8f7-3db7-438a-bc2c-c0b651c26d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:50.831312 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-0139e8f7-3db7-438a-bc2c-c0b651c26d1e None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:50.832764 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-0139e8f7-3db7-438a-bc2c-c0b651c26d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:50.840750 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 522/1050] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 30 20:52:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:52:50.995870 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a9853-ea07-41d3-8716-55ee3bc71a77 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:51.009520 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a9853-ea07-41d3-8716-55ee3bc71a77 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:51.015328 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9e018-3e0c-48e1-80b4-3e3c14bb972a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aee3a7a6b4b4d489993c131f3ae2048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:51.015960 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9e018-3e0c-48e1-80b4-3e3c14bb972a service nova] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:51.016250 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9e018-3e0c-48e1-80b4-3e3c14bb972a service nova] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:51.016529 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9e018-3e0c-48e1-80b4-3e3c14bb972a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:51.025003 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9e018-3e0c-48e1-80b4-3e3c14bb972a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:51.026673 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9e018-3e0c-48e1-80b4-3e3c14bb972a service nova] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:51.037166 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 529/1051] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:52:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:52:52.333896 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0c77e-04a4-46f1-8510-9d52be647240 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:52.334470 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0c77e-04a4-46f1-8510-9d52be647240 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:52.334470 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0c77e-04a4-46f1-8510-9d52be647240 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:52.335815 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 523/1052] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 30 20:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:52.340978 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c39fc4-d481-49ea-b7ed-9a14d94be452 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:52.341406 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c39fc4-d481-49ea-b7ed-9a14d94be452 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:52.341550 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c39fc4-d481-49ea-b7ed-9a14d94be452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:52.361483 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-07c39fc4-d481-49ea-b7ed-9a14d94be452 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:52.362658 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-07c39fc4-d481-49ea-b7ed-9a14d94be452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:52.370235 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 530/1053] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 30 20:52:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:52:52.523326 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c0c77e-04a4-46f1-8510-9d52be647240 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:52.537130 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c0c77e-04a4-46f1-8510-9d52be647240 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:52.541945 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f071d2-af8f-4057-b399-3ef6946d1e8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aee3a7a6b4b4d489993c131f3ae2048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:52.542575 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f071d2-af8f-4057-b399-3ef6946d1e8c service nova] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:52.542856 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f071d2-af8f-4057-b399-3ef6946d1e8c service nova] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:52.543133 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f071d2-af8f-4057-b399-3ef6946d1e8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:52.551090 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f071d2-af8f-4057-b399-3ef6946d1e8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:52.552665 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f071d2-af8f-4057-b399-3ef6946d1e8c service nova] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:52.561947 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 524/1054] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:52:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:52:53.909730 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa00220-ed1b-48a8-bbe4-306174485ae5 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:53.910259 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa00220-ed1b-48a8-bbe4-306174485ae5 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:53.910353 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa00220-ed1b-48a8-bbe4-306174485ae5 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:53.911682 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 531/1055] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 30 20:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:53.916831 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1c4de-2b79-4409-8756-c8968c28e62a None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:53.917300 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1c4de-2b79-4409-8756-c8968c28e62a None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:53.917408 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1c4de-2b79-4409-8756-c8968c28e62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:53.935642 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-c9e1c4de-2b79-4409-8756-c8968c28e62a None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:53.936829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-c9e1c4de-2b79-4409-8756-c8968c28e62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:53.944558 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 525/1056] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 30 20:52:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:52:54.097011 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa00220-ed1b-48a8-bbe4-306174485ae5 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:54.109800 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa00220-ed1b-48a8-bbe4-306174485ae5 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:54.114644 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90a429-a2d8-45a2-afca-8a0c1623a7ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aee3a7a6b4b4d489993c131f3ae2048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:54.115270 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90a429-a2d8-45a2-afca-8a0c1623a7ef service nova] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:54.115543 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90a429-a2d8-45a2-afca-8a0c1623a7ef service nova] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:54.115814 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90a429-a2d8-45a2-afca-8a0c1623a7ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:54.124188 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90a429-a2d8-45a2-afca-8a0c1623a7ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:54.125819 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90a429-a2d8-45a2-afca-8a0c1623a7ef service nova] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:54.135309 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 532/1057] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:52:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:52:56.342149 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef78bc-4541-41a5-a001-40d86af22af5 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:56.342715 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef78bc-4541-41a5-a001-40d86af22af5 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:56.342715 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef78bc-4541-41a5-a001-40d86af22af5 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:56.344064 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 526/1058] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 30 20:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:56.349516 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac218a-d35e-4b70-ace5-cb3992e10172 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:56.349929 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac218a-d35e-4b70-ace5-cb3992e10172 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:56.350047 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac218a-d35e-4b70-ace5-cb3992e10172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:56.367618 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-19ac218a-d35e-4b70-ace5-cb3992e10172 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:56.368793 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-19ac218a-d35e-4b70-ace5-cb3992e10172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:56.376940 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 533/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 30 20:52:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:52:56.415304 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef78bc-4541-41a5-a001-40d86af22af5 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:56.426854 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef78bc-4541-41a5-a001-40d86af22af5 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:56.430347 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8234a4f-4fc4-4b57-aabc-55691a296636 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:56.430975 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8234a4f-4fc4-4b57-aabc-55691a296636 service neutron] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:56.431263 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8234a4f-4fc4-4b57-aabc-55691a296636 service neutron] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:56.431540 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8234a4f-4fc4-4b57-aabc-55691a296636 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:56.441145 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8234a4f-4fc4-4b57-aabc-55691a296636 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:56.442579 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8234a4f-4fc4-4b57-aabc-55691a296636 service neutron] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:56.452117 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 527/1060] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:52:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:52:58.895399 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947876d-b47e-491d-9fa1-0bc4b821ba3e None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:58.895858 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947876d-b47e-491d-9fa1-0bc4b821ba3e None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:58.895951 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947876d-b47e-491d-9fa1-0bc4b821ba3e None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:58.897350 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 534/1061] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 30 20:52:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:58.902627 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b44971-7f9a-4423-8ff2-81173ec054f3 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:58.903033 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b44971-7f9a-4423-8ff2-81173ec054f3 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:58.903296 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b44971-7f9a-4423-8ff2-81173ec054f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:58.920795 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-e6b44971-7f9a-4423-8ff2-81173ec054f3 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:58.921993 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-e6b44971-7f9a-4423-8ff2-81173ec054f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:58.929624 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 528/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 30 20:52:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:52:58.968627 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947876d-b47e-491d-9fa1-0bc4b821ba3e None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:58.979026 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947876d-b47e-491d-9fa1-0bc4b821ba3e None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:58.982591 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75949b-fd3e-485e-a5dc-05e748b53dfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:58.983335 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75949b-fd3e-485e-a5dc-05e748b53dfe service neutron] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:58.983618 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75949b-fd3e-485e-a5dc-05e748b53dfe service neutron] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:58.983892 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75949b-fd3e-485e-a5dc-05e748b53dfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:58.992472 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f75949b-fd3e-485e-a5dc-05e748b53dfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:58.993927 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f75949b-fd3e-485e-a5dc-05e748b53dfe service neutron] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:59.003722 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 535/1063] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:52:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:53:01.698260 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420f42f-d686-4fbb-8c81-0eec82c1c1b3 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:53:01.698858 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420f42f-d686-4fbb-8c81-0eec82c1c1b3 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:53:01.698858 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420f42f-d686-4fbb-8c81-0eec82c1c1b3 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:53:01.700182 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 529/1064] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 30 20:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:53:01.706504 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0f3e0-17dd-40e6-b1ea-f5e8b6249fa2 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:53:01.707179 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0f3e0-17dd-40e6-b1ea-f5e8b6249fa2 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:53:01.707311 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0f3e0-17dd-40e6-b1ea-f5e8b6249fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:53:01.725631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-b0c0f3e0-17dd-40e6-b1ea-f5e8b6249fa2 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:53:01.726824 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-b0c0f3e0-17dd-40e6-b1ea-f5e8b6249fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:53:01.734528 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 536/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 30 20:53:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:53:01.773370 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420f42f-d686-4fbb-8c81-0eec82c1c1b3 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:53:01.784689 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420f42f-d686-4fbb-8c81-0eec82c1c1b3 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:53:01.788171 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f7451-9a8f-46ba-bbf6-d59e83a7ed8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:53:01.788799 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f7451-9a8f-46ba-bbf6-d59e83a7ed8a service neutron] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:53:01.789116 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f7451-9a8f-46ba-bbf6-d59e83a7ed8a service neutron] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:53:01.789395 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f7451-9a8f-46ba-bbf6-d59e83a7ed8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:53:01.798528 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f7451-9a8f-46ba-bbf6-d59e83a7ed8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:53:01.799943 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f7451-9a8f-46ba-bbf6-d59e83a7ed8a service neutron] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:53:01.809480 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 530/1066] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:53:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:53:04.308740 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c739c-39e7-4972-a120-8017cc0dea96 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:53:04.309331 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c739c-39e7-4972-a120-8017cc0dea96 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:53:04.309331 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c739c-39e7-4972-a120-8017cc0dea96 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:53:04.311192 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 537/1067] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 30 20:53:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:53:04.316542 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf9345-89a2-4907-b6c2-021c602997d9 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:53:04.316974 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf9345-89a2-4907-b6c2-021c602997d9 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:53:04.317143 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf9345-89a2-4907-b6c2-021c602997d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:53:04.335225 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-abaf9345-89a2-4907-b6c2-021c602997d9 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:53:04.336402 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-abaf9345-89a2-4907-b6c2-021c602997d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:53:04.344141 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 531/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 30 20:53:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:53:04.382937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c739c-39e7-4972-a120-8017cc0dea96 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:53:04.395648 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c739c-39e7-4972-a120-8017cc0dea96 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:53:04.399341 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f596f12a-3ad8-4a5d-aeda-5d798890ccb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:53:04.399961 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596f12a-3ad8-4a5d-aeda-5d798890ccb4 service neutron] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:53:04.400237 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596f12a-3ad8-4a5d-aeda-5d798890ccb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:53:04.400506 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596f12a-3ad8-4a5d-aeda-5d798890ccb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:53:04.409164 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f596f12a-3ad8-4a5d-aeda-5d798890ccb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:53:04.410625 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f596f12a-3ad8-4a5d-aeda-5d798890ccb4 service neutron] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:53:04.420429 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 538/1069] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:53:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:53:06.757571 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe7d90-4bcd-4432-b206-702587194dfd None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:53:06.758141 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe7d90-4bcd-4432-b206-702587194dfd None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:53:06.758141 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe7d90-4bcd-4432-b206-702587194dfd None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:53:06.759492 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 532/1070] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 30 20:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:53:06.765401 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3329748-cf10-4519-a116-3bb38b9cf803 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:53:06.765925 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3329748-cf10-4519-a116-3bb38b9cf803 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:53:06.766034 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3329748-cf10-4519-a116-3bb38b9cf803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:53:06.783161 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-b3329748-cf10-4519-a116-3bb38b9cf803 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:53:06.784380 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-b3329748-cf10-4519-a116-3bb38b9cf803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:53:06.792046 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 539/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 30 20:53:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 20:53:06.831207 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe7d90-4bcd-4432-b206-702587194dfd None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:53:06.842268 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe7d90-4bcd-4432-b206-702587194dfd None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:53:06.845765 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1c0e7-31c9-493d-89a0-d3fc6876bcbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:53:06.846394 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1c0e7-31c9-493d-89a0-d3fc6876bcbf service neutron] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:53:06.846676 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1c0e7-31c9-493d-89a0-d3fc6876bcbf service neutron] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:53:06.846979 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1c0e7-31c9-493d-89a0-d3fc6876bcbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:53:06.855565 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1c0e7-31c9-493d-89a0-d3fc6876bcbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:53:06.857056 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1c0e7-31c9-493d-89a0-d3fc6876bcbf service neutron] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:53:06.866162 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 533/1072] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:53:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:53:09.174314 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c4817-6f2c-4499-9937-cc33c6bdf4ec None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:53:09.174825 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c4817-6f2c-4499-9937-cc33c6bdf4ec None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:53:09.174825 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c4817-6f2c-4499-9937-cc33c6bdf4ec None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:53:09.176115 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 540/1073] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 30 20:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:53:09.181309 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d89f98-f0cc-4b4c-b2b1-e3aec47d75aa None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:53:09.181692 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d89f98-f0cc-4b4c-b2b1-e3aec47d75aa None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:53:09.181863 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d89f98-f0cc-4b4c-b2b1-e3aec47d75aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:53:09.199751 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-d4d89f98-f0cc-4b4c-b2b1-e3aec47d75aa None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:53:09.201012 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-d4d89f98-f0cc-4b4c-b2b1-e3aec47d75aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:53:09.208843 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 534/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 30 20:53:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:53:09.247725 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c4817-6f2c-4499-9937-cc33c6bdf4ec None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:53:09.258598 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c4817-6f2c-4499-9937-cc33c6bdf4ec None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:53:09.262104 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7703c8-d280-4bbf-9fd7-de9c858ac77c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:53:09.262770 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7703c8-d280-4bbf-9fd7-de9c858ac77c service neutron] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:53:09.263064 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7703c8-d280-4bbf-9fd7-de9c858ac77c service neutron] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:53:09.263574 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7703c8-d280-4bbf-9fd7-de9c858ac77c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:53:09.272606 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7703c8-d280-4bbf-9fd7-de9c858ac77c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:53:09.274120 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7703c8-d280-4bbf-9fd7-de9c858ac77c service neutron] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:53:09.284070 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 541/1075] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:53:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:53:11.605870 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed41c17-83d7-4c8a-ba23-86d57b648a11 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:53:11.606926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed41c17-83d7-4c8a-ba23-86d57b648a11 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:53:11.606926 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed41c17-83d7-4c8a-ba23-86d57b648a11 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:53:11.608307 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 535/1076] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 30 20:53:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:53:11.613516 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c5b29-01a3-4f9f-bb5e-eeb8a99f9b66 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:53:11.613922 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c5b29-01a3-4f9f-bb5e-eeb8a99f9b66 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:53:11.614065 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c5b29-01a3-4f9f-bb5e-eeb8a99f9b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:53:11.632545 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-9a2c5b29-01a3-4f9f-bb5e-eeb8a99f9b66 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:53:11.633746 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-9a2c5b29-01a3-4f9f-bb5e-eeb8a99f9b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:53:11.641753 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 542/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 30 20:53:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:53:11.681866 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed41c17-83d7-4c8a-ba23-86d57b648a11 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:53:11.692841 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed41c17-83d7-4c8a-ba23-86d57b648a11 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:53:11.696273 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3212234-c0bc-4992-9dd0-31c107bb640f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:53:11.696895 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3212234-c0bc-4992-9dd0-31c107bb640f service neutron] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:53:11.697206 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3212234-c0bc-4992-9dd0-31c107bb640f service neutron] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:53:11.700683 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3212234-c0bc-4992-9dd0-31c107bb640f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:53:11.706138 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3212234-c0bc-4992-9dd0-31c107bb640f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:53:11.707834 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3212234-c0bc-4992-9dd0-31c107bb640f service neutron] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:53:11.717552 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 536/1078] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:53:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:53:14.029284 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9f9bb-b54c-4a03-bf8b-49146ef2c12e None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:53:14.029859 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9f9bb-b54c-4a03-bf8b-49146ef2c12e None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:53:14.029956 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9f9bb-b54c-4a03-bf8b-49146ef2c12e None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:53:14.031248 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 543/1079] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 30 20:53:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:53:14.036677 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31917d3e-bbd0-4a30-be38-be82b7242fbb None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:53:14.037115 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31917d3e-bbd0-4a30-be38-be82b7242fbb None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:53:14.041240 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31917d3e-bbd0-4a30-be38-be82b7242fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:53:14.054402 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-31917d3e-bbd0-4a30-be38-be82b7242fbb None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:53:14.055603 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-31917d3e-bbd0-4a30-be38-be82b7242fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:53:14.063545 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 537/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 30 20:53:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:53:14.102819 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9f9bb-b54c-4a03-bf8b-49146ef2c12e None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:53:14.113436 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9f9bb-b54c-4a03-bf8b-49146ef2c12e None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:53:14.116915 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4e8d2-e02a-4e60-aea4-19f109803164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:53:14.117634 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4e8d2-e02a-4e60-aea4-19f109803164 service neutron] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:53:14.117911 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4e8d2-e02a-4e60-aea4-19f109803164 service neutron] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:53:14.118182 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4e8d2-e02a-4e60-aea4-19f109803164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:53:14.126944 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4e8d2-e02a-4e60-aea4-19f109803164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:53:14.128374 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4e8d2-e02a-4e60-aea4-19f109803164 service neutron] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:53:14.137480 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 544/1081] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:53:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:53:16.483845 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef098f2-c566-47f7-950f-7fac44a29f3b None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:53:16.484510 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef098f2-c566-47f7-950f-7fac44a29f3b None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:53:16.484510 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef098f2-c566-47f7-950f-7fac44a29f3b None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:53:16.485970 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 538/1082] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 30 20:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:53:16.491973 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53b263-7157-413c-9a7b-4d9bc362587f None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:53:16.492426 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53b263-7157-413c-9a7b-4d9bc362587f None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:53:16.492527 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53b263-7157-413c-9a7b-4d9bc362587f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:53:16.510169 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-4b53b263-7157-413c-9a7b-4d9bc362587f None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:53:16.511341 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-4b53b263-7157-413c-9a7b-4d9bc362587f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:53:16.519933 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 545/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 30 20:53:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:53:16.556959 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef098f2-c566-47f7-950f-7fac44a29f3b None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:53:16.567966 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef098f2-c566-47f7-950f-7fac44a29f3b None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:53:16.571427 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ac75d-bf95-4c83-8864-c1c7e9bd1aec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:53:16.572060 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ac75d-bf95-4c83-8864-c1c7e9bd1aec service neutron] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:53:16.572340 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ac75d-bf95-4c83-8864-c1c7e9bd1aec service neutron] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:53:16.572616 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ac75d-bf95-4c83-8864-c1c7e9bd1aec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:53:16.582190 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ac75d-bf95-4c83-8864-c1c7e9bd1aec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:53:16.583619 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ac75d-bf95-4c83-8864-c1c7e9bd1aec service neutron] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:53:16.592761 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 539/1084] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:53:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:53:18.958753 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649c322-e0dc-4f69-b4d7-29c499a28daf None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:53:18.959298 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649c322-e0dc-4f69-b4d7-29c499a28daf None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:53:18.959298 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649c322-e0dc-4f69-b4d7-29c499a28daf None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:53:18.960631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 546/1085] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 30 20:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:53:18.966052 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5114f1-532e-461e-ad77-195075f0f6a6 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:53:18.966505 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5114f1-532e-461e-ad77-195075f0f6a6 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:53:18.966602 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5114f1-532e-461e-ad77-195075f0f6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:53:18.984142 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-af5114f1-532e-461e-ad77-195075f0f6a6 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:53:18.985371 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-af5114f1-532e-461e-ad77-195075f0f6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:53:18.993051 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 540/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 30 20:53:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:53:19.031176 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649c322-e0dc-4f69-b4d7-29c499a28daf None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:53:19.041730 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649c322-e0dc-4f69-b4d7-29c499a28daf None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:53:19.045532 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cea6bd-e915-458d-9430-4a82b24e3e6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:53:19.046165 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cea6bd-e915-458d-9430-4a82b24e3e6f service neutron] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:53:19.046451 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cea6bd-e915-458d-9430-4a82b24e3e6f service neutron] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:53:19.046758 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cea6bd-e915-458d-9430-4a82b24e3e6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:53:19.055672 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cea6bd-e915-458d-9430-4a82b24e3e6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:53:19.057147 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cea6bd-e915-458d-9430-4a82b24e3e6f service neutron] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:53:19.067139 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 547/1087] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:53:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:53:53.592932 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703961df-567b-4273-ab40-dbaa4b044a8c None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:53:53.593531 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703961df-567b-4273-ab40-dbaa4b044a8c None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:53:53.593531 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703961df-567b-4273-ab40-dbaa4b044a8c None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:53:53.594850 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 541/1088] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:53:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:53:53.599988 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76a98c-b3b2-428b-9466-850b6ae5c336 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:53:53.600446 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76a98c-b3b2-428b-9466-850b6ae5c336 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:53:53.600549 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76a98c-b3b2-428b-9466-850b6ae5c336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:53:53.618302 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-3b76a98c-b3b2-428b-9466-850b6ae5c336 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:53:53.619477 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-3b76a98c-b3b2-428b-9466-850b6ae5c336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:53:53.627828 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 548/1089] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:53:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:53:53.677985 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbdc30-f4c5-4c29-a83c-057c6726e6fa None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:53:53.678272 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbdc30-f4c5-4c29-a83c-057c6726e6fa None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:53:53.678552 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbdc30-f4c5-4c29-a83c-057c6726e6fa None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:53:53.679887 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 542/1090] 10.222.0.26 () {54 vars in 962 bytes} [Sat Apr 30 20:53:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:53:53.685405 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5c5e8-5be3-41cf-9b21-f86486bbb742 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:53:53.685698 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5c5e8-5be3-41cf-9b21-f86486bbb742 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:53:53.685979 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5c5e8-5be3-41cf-9b21-f86486bbb742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:53:53.703481 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-5ac5c5e8-5be3-41cf-9b21-f86486bbb742 None None] MFA Rules not processed for user `43ed44bbd52047cbbcab1bc72d650b8e`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:53:53.707272 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-5ac5c5e8-5be3-41cf-9b21-f86486bbb742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:53:53.711333 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 549/1091] 10.222.0.26 () {58 vars in 1059 bytes} [Sat Apr 30 20:53:53 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:53:53.718548 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbdc30-f4c5-4c29-a83c-057c6726e6fa None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:53:53.728766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbdc30-f4c5-4c29-a83c-057c6726e6fa None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:53:53.732699 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086c0ad-2bb6-4735-b2aa-663ead79bcad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ed44bbd52047cbbcab1bc72d650b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:53:53.736985 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086c0ad-2bb6-4735-b2aa-663ead79bcad service glance] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:53:53.736985 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086c0ad-2bb6-4735-b2aa-663ead79bcad service glance] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:53:53.736985 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086c0ad-2bb6-4735-b2aa-663ead79bcad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:53:53.742415 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086c0ad-2bb6-4735-b2aa-663ead79bcad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:53:53.743822 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086c0ad-2bb6-4735-b2aa-663ead79bcad service glance] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:53:53.753933 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 543/1092] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:53:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:53:56.157404 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23912c-8fd3-4e4d-89d7-05ac0298cc5f None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:53:56.157925 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23912c-8fd3-4e4d-89d7-05ac0298cc5f None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:53:56.157925 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23912c-8fd3-4e4d-89d7-05ac0298cc5f None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:53:56.159223 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 550/1093] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:53:56.164321 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3b668-63cf-401f-bb7f-27d090564f7a None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:53:56.164712 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3b668-63cf-401f-bb7f-27d090564f7a None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:53:56.164886 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3b668-63cf-401f-bb7f-27d090564f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:53:56.183758 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-6ed3b668-63cf-401f-bb7f-27d090564f7a None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:53:56.185010 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-6ed3b668-63cf-401f-bb7f-27d090564f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:53:56.192732 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 544/1094] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:53:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:53:56.217290 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23912c-8fd3-4e4d-89d7-05ac0298cc5f None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:53:56.230047 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23912c-8fd3-4e4d-89d7-05ac0298cc5f None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:53:56.234431 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657521f-f9ea-49df-bc2a-d19eb01f74d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:53:56.235061 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657521f-f9ea-49df-bc2a-d19eb01f74d2 admin admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:53:56.235370 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657521f-f9ea-49df-bc2a-d19eb01f74d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:53:56.235646 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657521f-f9ea-49df-bc2a-d19eb01f74d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:53:56.236373 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657521f-f9ea-49df-bc2a-d19eb01f74d2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:53:56.238132 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: WARNING py.warnings [None req-e657521f-f9ea-49df-bc2a-d19eb01f74d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 20:53:56.238132 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: warnings.warn(msg) Apr 30 20:53:56.238132 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: Apr 30 20:53:56.239257 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657521f-f9ea-49df-bc2a-d19eb01f74d2 admin admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:53:56.256853 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 551/1095] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Apr 30 20:53:56 2022] GET /identity/v3/projects => generated 1606 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 20:53:58.567057 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880636f5-f39d-4d36-8593-b0f1e454b8b9 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:53:58.567614 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880636f5-f39d-4d36-8593-b0f1e454b8b9 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:53:58.567614 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880636f5-f39d-4d36-8593-b0f1e454b8b9 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:53:58.568996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 545/1096] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:53:58.574856 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e69f0-f2f7-4474-8ce9-d0c52b354110 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:53:58.575311 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e69f0-f2f7-4474-8ce9-d0c52b354110 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:53:58.575469 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e69f0-f2f7-4474-8ce9-d0c52b354110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:53:58.593388 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-c94e69f0-f2f7-4474-8ce9-d0c52b354110 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:53:58.594584 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-c94e69f0-f2f7-4474-8ce9-d0c52b354110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:53:58.602319 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 552/1097] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:53:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:53:58.646378 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880636f5-f39d-4d36-8593-b0f1e454b8b9 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:53:58.659594 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880636f5-f39d-4d36-8593-b0f1e454b8b9 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:53:58.664398 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f67326-66e7-4e81-ad01-43572e46378b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aee3a7a6b4b4d489993c131f3ae2048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:53:58.665062 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f67326-66e7-4e81-ad01-43572e46378b service nova] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:53:58.665345 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f67326-66e7-4e81-ad01-43572e46378b service nova] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:53:58.665619 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f67326-66e7-4e81-ad01-43572e46378b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:53:58.673722 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f67326-66e7-4e81-ad01-43572e46378b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:53:58.678442 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f67326-66e7-4e81-ad01-43572e46378b service nova] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:53:58.685253 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 546/1098] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:53:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:54:01.132575 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434e9ef-f509-4512-83bb-7f59a1bcb0ac None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:54:01.133118 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434e9ef-f509-4512-83bb-7f59a1bcb0ac None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:54:01.133118 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434e9ef-f509-4512-83bb-7f59a1bcb0ac None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:54:01.134455 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 553/1099] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:54:01.140242 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9205a4-5195-4a2e-9c81-50f8c85912e7 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:54:01.140666 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9205a4-5195-4a2e-9c81-50f8c85912e7 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:54:01.140768 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9205a4-5195-4a2e-9c81-50f8c85912e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:54:01.159120 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-9b9205a4-5195-4a2e-9c81-50f8c85912e7 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:54:01.160293 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-9b9205a4-5195-4a2e-9c81-50f8c85912e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:54:01.168062 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 547/1100] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:54:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:54:01.204844 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434e9ef-f509-4512-83bb-7f59a1bcb0ac None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:54:01.215938 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434e9ef-f509-4512-83bb-7f59a1bcb0ac None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:54:01.219424 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1889c20-79be-4484-a8df-d8e5e3cc1c69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:54:01.220080 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1889c20-79be-4484-a8df-d8e5e3cc1c69 service neutron] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:54:01.220362 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1889c20-79be-4484-a8df-d8e5e3cc1c69 service neutron] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:54:01.220636 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1889c20-79be-4484-a8df-d8e5e3cc1c69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:54:01.229672 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1889c20-79be-4484-a8df-d8e5e3cc1c69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:54:01.231124 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1889c20-79be-4484-a8df-d8e5e3cc1c69 service neutron] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:54:01.240262 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 554/1101] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:54:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:54:03.568761 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e374db7-61ca-4257-8cae-c9ad0c43d104 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:54:03.569348 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e374db7-61ca-4257-8cae-c9ad0c43d104 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:54:03.569348 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e374db7-61ca-4257-8cae-c9ad0c43d104 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:54:03.570696 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 548/1102] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:54:03.576273 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ee86c-6a9e-465b-86c1-40e4c61d5a68 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:54:03.576695 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ee86c-6a9e-465b-86c1-40e4c61d5a68 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:54:03.576947 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ee86c-6a9e-465b-86c1-40e4c61d5a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:54:03.595456 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-636ee86c-6a9e-465b-86c1-40e4c61d5a68 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:54:03.596636 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-636ee86c-6a9e-465b-86c1-40e4c61d5a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:54:03.604522 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 555/1103] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:54:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:54:03.643239 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e374db7-61ca-4257-8cae-c9ad0c43d104 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:54:03.654556 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e374db7-61ca-4257-8cae-c9ad0c43d104 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:54:03.658690 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ceb928-537a-4b3d-80cf-2241f1833c67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:54:03.658816 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ceb928-537a-4b3d-80cf-2241f1833c67 service neutron] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:54:03.659056 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ceb928-537a-4b3d-80cf-2241f1833c67 service neutron] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:54:03.659330 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ceb928-537a-4b3d-80cf-2241f1833c67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:54:03.668356 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ceb928-537a-4b3d-80cf-2241f1833c67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:54:03.669810 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ceb928-537a-4b3d-80cf-2241f1833c67 service neutron] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:54:03.679237 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 549/1104] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:54:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 20:54:06.047803 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d609e-9bc6-4cd5-b93f-41226e0892f4 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:54:06.048324 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d609e-9bc6-4cd5-b93f-41226e0892f4 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:54:06.048422 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d609e-9bc6-4cd5-b93f-41226e0892f4 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:54:06.049739 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 556/1105] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:54:06.054719 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32a7da-ea59-402a-9de1-c30493783a59 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:54:06.055184 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32a7da-ea59-402a-9de1-c30493783a59 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:54:06.055288 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32a7da-ea59-402a-9de1-c30493783a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:54:06.073887 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-8e32a7da-ea59-402a-9de1-c30493783a59 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:54:06.074999 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-8e32a7da-ea59-402a-9de1-c30493783a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:54:06.082978 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 550/1106] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:54:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:54:06.123227 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d609e-9bc6-4cd5-b93f-41226e0892f4 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:54:06.133742 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d609e-9bc6-4cd5-b93f-41226e0892f4 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:54:06.137970 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02407f3-8d1d-4a26-9f32-187bd37103bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:54:06.138594 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02407f3-8d1d-4a26-9f32-187bd37103bb service neutron] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:54:06.138875 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02407f3-8d1d-4a26-9f32-187bd37103bb service neutron] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:54:06.139151 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02407f3-8d1d-4a26-9f32-187bd37103bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:54:06.147801 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02407f3-8d1d-4a26-9f32-187bd37103bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:54:06.149333 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02407f3-8d1d-4a26-9f32-187bd37103bb service neutron] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:54:06.158559 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 557/1107] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:54:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:54:08.871104 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e9e9a-f195-4c79-89d9-a0761f236449 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:54:08.871664 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e9e9a-f195-4c79-89d9-a0761f236449 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:54:08.871664 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e9e9a-f195-4c79-89d9-a0761f236449 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:54:08.873091 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 551/1108] 10.222.0.26 () {54 vars in 926 bytes} [Sat Apr 30 20:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:54:08.878778 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce64d0-4d82-4974-ade5-a3ec0081fe89 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:54:08.879178 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce64d0-4d82-4974-ade5-a3ec0081fe89 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:54:08.879329 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce64d0-4d82-4974-ade5-a3ec0081fe89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:54:08.897164 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-92ce64d0-4d82-4974-ade5-a3ec0081fe89 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:54:08.900698 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-92ce64d0-4d82-4974-ade5-a3ec0081fe89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:54:08.907622 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 558/1109] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Apr 30 20:54:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:54:08.947261 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e9e9a-f195-4c79-89d9-a0761f236449 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:54:08.958681 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e9e9a-f195-4c79-89d9-a0761f236449 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:54:08.962205 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97153a-96e5-4dc8-a36f-cce90248ebcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:54:08.962837 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97153a-96e5-4dc8-a36f-cce90248ebcc service neutron] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:54:08.963118 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97153a-96e5-4dc8-a36f-cce90248ebcc service neutron] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:54:08.963391 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97153a-96e5-4dc8-a36f-cce90248ebcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:54:08.972592 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97153a-96e5-4dc8-a36f-cce90248ebcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:54:08.974056 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97153a-96e5-4dc8-a36f-cce90248ebcc service neutron] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:54:08.983489 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 552/1110] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:54:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:56:15.233492 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbeab43-8f47-4e40-9cef-a0c0c6fc811f None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:56:15.234109 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbeab43-8f47-4e40-9cef-a0c0c6fc811f None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:56:15.234109 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbeab43-8f47-4e40-9cef-a0c0c6fc811f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:56:15.252896 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-dfbeab43-8f47-4e40-9cef-a0c0c6fc811f None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:56:15.254133 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-dfbeab43-8f47-4e40-9cef-a0c0c6fc811f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:56:15.262197 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 559/1111] 10.222.0.26 () {58 vars in 957 bytes} [Sat Apr 30 20:56:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:56:15.270925 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5cd04-ed20-4f15-ba66-b909d6c01576 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:56:15.271433 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5cd04-ed20-4f15-ba66-b909d6c01576 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:56:15.271605 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5cd04-ed20-4f15-ba66-b909d6c01576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:56:15.290160 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-3cd5cd04-ed20-4f15-ba66-b909d6c01576 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:56:15.294419 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-3cd5cd04-ed20-4f15-ba66-b909d6c01576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:56:15.299410 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 553/1112] 10.222.0.26 () {58 vars in 957 bytes} [Sat Apr 30 20:56:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:56:15.303948 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbeab43-8f47-4e40-9cef-a0c0c6fc811f None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:56:15.313291 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbeab43-8f47-4e40-9cef-a0c0c6fc811f None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:56:15.317845 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031eba4-1486-4852-adb4-9bce7142ac41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:56:15.318499 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031eba4-1486-4852-adb4-9bce7142ac41 admin admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:56:15.318777 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031eba4-1486-4852-adb4-9bce7142ac41 admin admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:56:15.319045 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031eba4-1486-4852-adb4-9bce7142ac41 admin admin] PATH_INFO: `/v3/domains` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:56:15.319764 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031eba4-1486-4852-adb4-9bce7142ac41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:56:15.320060 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031eba4-1486-4852-adb4-9bce7142ac41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:56:15.321118 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: WARNING py.warnings [None req-0031eba4-1486-4852-adb4-9bce7142ac41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 20:56:15.321118 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: warnings.warn(msg) Apr 30 20:56:15.321118 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: Apr 30 20:56:15.322018 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031eba4-1486-4852-adb4-9bce7142ac41 admin admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:56:15.334623 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 560/1113] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Apr 30 20:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:56:15.343099 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5cd04-ed20-4f15-ba66-b909d6c01576 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:56:15.352414 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5cd04-ed20-4f15-ba66-b909d6c01576 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:56:15.357238 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe38a95-dade-4112-af7b-a3491889b4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:56:15.357883 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe38a95-dade-4112-af7b-a3491889b4bd admin admin] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:56:15.358164 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe38a95-dade-4112-af7b-a3491889b4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:56:15.358464 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe38a95-dade-4112-af7b-a3491889b4bd admin admin] PATH_INFO: `/v3/projects` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:56:15.359156 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe38a95-dade-4112-af7b-a3491889b4bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:56:15.360888 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: WARNING py.warnings [None req-8fe38a95-dade-4112-af7b-a3491889b4bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 20:56:15.360888 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: warnings.warn(msg) Apr 30 20:56:15.360888 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: Apr 30 20:56:15.362095 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe38a95-dade-4112-af7b-a3491889b4bd admin admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:56:15.487402 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 554/1114] 10.222.0.26 () {60 vars in 1152 bytes} [Sat Apr 30 20:56:15 2022] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 20:56:15.491513 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031eba4-1486-4852-adb4-9bce7142ac41 admin admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:56:15.501395 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031eba4-1486-4852-adb4-9bce7142ac41 admin admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:56:15.555013 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c19900-4035-4adb-9088-1a9c351465b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:56:15.555695 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c19900-4035-4adb-9088-1a9c351465b5 admin admin] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:56:15.555973 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c19900-4035-4adb-9088-1a9c351465b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:56:15.556244 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c19900-4035-4adb-9088-1a9c351465b5 admin admin] PATH_INFO: `/v3/users` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:56:15.556938 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c19900-4035-4adb-9088-1a9c351465b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:56:15.558081 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: WARNING py.warnings [None req-e0c19900-4035-4adb-9088-1a9c351465b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 20:56:15.558081 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: warnings.warn(msg) Apr 30 20:56:15.558081 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: Apr 30 20:56:15.559825 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c19900-4035-4adb-9088-1a9c351465b5 admin admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:56:15.629082 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 561/1115] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Apr 30 20:56:15 2022] POST /identity/v3/users => generated 289 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:56:15.633427 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe38a95-dade-4112-af7b-a3491889b4bd admin admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:56:15.644197 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe38a95-dade-4112-af7b-a3491889b4bd admin admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:56:15.648793 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad0095-2d00-43e8-8830-e698d657a5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:56:15.649473 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad0095-2d00-43e8-8830-e698d657a5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:56:15.649840 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad0095-2d00-43e8-8830-e698d657a5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:56:15.650118 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad0095-2d00-43e8-8830-e698d657a5e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:56:15.650836 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad0095-2d00-43e8-8830-e698d657a5e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:56:15.652223 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: WARNING py.warnings [None req-b2ad0095-2d00-43e8-8830-e698d657a5e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 20:56:15.652223 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: warnings.warn(msg) Apr 30 20:56:15.652223 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: Apr 30 20:56:15.653203 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad0095-2d00-43e8-8830-e698d657a5e5 admin admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:56:15.665758 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 555/1116] 10.222.0.26 () {58 vars in 1121 bytes} [Sat Apr 30 20:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 20:56:15.669671 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c19900-4035-4adb-9088-1a9c351465b5 admin admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:56:15.679392 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c19900-4035-4adb-9088-1a9c351465b5 admin admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:56:15.683941 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3267c-8c02-459c-ad5e-a9d438e03c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:56:15.685147 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3267c-8c02-459c-ad5e-a9d438e03c9f admin admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:56:15.685446 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3267c-8c02-459c-ad5e-a9d438e03c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:56:15.685717 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3267c-8c02-459c-ad5e-a9d438e03c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:56:15.686422 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a3267c-8c02-459c-ad5e-a9d438e03c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:56:15.687424 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: WARNING py.warnings [None req-89a3267c-8c02-459c-ad5e-a9d438e03c9f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 20:56:15.687424 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: warnings.warn(msg) Apr 30 20:56:15.687424 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: Apr 30 20:56:15.688321 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a3267c-8c02-459c-ad5e-a9d438e03c9f admin admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:56:15.702397 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 562/1117] 10.222.0.26 () {58 vars in 1121 bytes} [Sat Apr 30 20:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 20:56:15.706343 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad0095-2d00-43e8-8830-e698d657a5e5 admin admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:56:15.716580 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad0095-2d00-43e8-8830-e698d657a5e5 admin admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:56:15.721209 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2583b79-a563-47da-bfff-06f4d60fb335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:56:15.722074 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2583b79-a563-47da-bfff-06f4d60fb335 admin admin] REQUEST_METHOD: `PUT` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:56:15.722359 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2583b79-a563-47da-bfff-06f4d60fb335 admin admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:56:15.722632 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2583b79-a563-47da-bfff-06f4d60fb335 admin admin] PATH_INFO: `/v3/projects/66efe6375d924cf8a85810eda1f2dd9c/users/7e9a3d5404954e98a005b18a2d9680d0/roles/375abc9f701c408ea332eaf2d8a2e086` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:56:15.736869 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2583b79-a563-47da-bfff-06f4d60fb335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66efe6375d924cf8a85810eda1f2dd9c, user_id=7e9a3d5404954e98a005b18a2d9680d0, role_id=375abc9f701c408ea332eaf2d8a2e086)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:56:15.737975 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: WARNING py.warnings [None req-c2583b79-a563-47da-bfff-06f4d60fb335 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 20:56:15.737975 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: warnings.warn(msg) Apr 30 20:56:15.737975 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: Apr 30 20:56:15.739842 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2583b79-a563-47da-bfff-06f4d60fb335 admin admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:56:15.823736 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 556/1118] 10.222.0.26 () {60 vars in 1482 bytes} [Sat Apr 30 20:56:15 2022] PUT /identity/v3/projects/66efe6375d924cf8a85810eda1f2dd9c/users/7e9a3d5404954e98a005b18a2d9680d0/roles/375abc9f701c408ea332eaf2d8a2e086 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:56:15.835839 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be437e-f7da-4476-9a6f-edd1d8831d7f None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:56:15.836230 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be437e-f7da-4476-9a6f-edd1d8831d7f None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:56:15.836514 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be437e-f7da-4476-9a6f-edd1d8831d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:56:15.862013 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-79be437e-f7da-4476-9a6f-edd1d8831d7f None None] MFA Rules not processed for user `7e9a3d5404954e98a005b18a2d9680d0`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:56:15.863238 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-79be437e-f7da-4476-9a6f-edd1d8831d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:56:15.926444 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 563/1119] 10.222.0.26 () {58 vars in 957 bytes} [Sat Apr 30 20:56:15 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:56:15.938105 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2583b79-a563-47da-bfff-06f4d60fb335 admin admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:56:16.011287 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2583b79-a563-47da-bfff-06f4d60fb335 admin admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:56:16.011287 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37d840-7da9-4544-9018-60b87e943fc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aee3a7a6b4b4d489993c131f3ae2048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:56:16.011287 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37d840-7da9-4544-9018-60b87e943fc6 service nova] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:56:16.011287 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37d840-7da9-4544-9018-60b87e943fc6 service nova] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:56:16.011737 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37d840-7da9-4544-9018-60b87e943fc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:56:16.015466 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37d840-7da9-4544-9018-60b87e943fc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:56:16.017175 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37d840-7da9-4544-9018-60b87e943fc6 service nova] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:56:16.025768 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 557/1120] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:56:15 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:56:16.089790 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2148a-6cc6-4d32-aacf-e63f6b8c0866 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:56:16.093881 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2148a-6cc6-4d32-aacf-e63f6b8c0866 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:56:16.093881 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2148a-6cc6-4d32-aacf-e63f6b8c0866 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:56:16.093881 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 564/1121] 10.222.0.26 () {52 vars in 829 bytes} [Sat Apr 30 20:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:56:16.095055 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37d840-7da9-4544-9018-60b87e943fc6 service nova] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:56:16.155889 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37d840-7da9-4544-9018-60b87e943fc6 service nova] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:56:16.160486 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd52fb6-53ea-4cda-a1fd-202620d8c291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:56:16.161372 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd52fb6-53ea-4cda-a1fd-202620d8c291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:56:16.161658 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd52fb6-53ea-4cda-a1fd-202620d8c291 admin admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:56:16.161935 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd52fb6-53ea-4cda-a1fd-202620d8c291 admin admin] PATH_INFO: `/v3/users/7e9a3d5404954e98a005b18a2d9680d0` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:56:16.163124 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd52fb6-53ea-4cda-a1fd-202620d8c291 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e9a3d5404954e98a005b18a2d9680d0)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:56:16.164138 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: WARNING py.warnings [None req-cfd52fb6-53ea-4cda-a1fd-202620d8c291 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 20:56:16.164138 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: warnings.warn(msg) Apr 30 20:56:16.164138 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: Apr 30 20:56:16.165448 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd52fb6-53ea-4cda-a1fd-202620d8c291 admin admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:56:17.030418 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [None req-cfd52fb6-53ea-4cda-a1fd-202620d8c291 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e9a3d5404954e98a005b18a2d9680d0'} {{(pid=98588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 20:56:17.042020 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [None req-cfd52fb6-53ea-4cda-a1fd-202620d8c291 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e9a3d5404954e98a005b18a2d9680d0'} {{(pid=98588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 20:56:17.042657 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [None req-cfd52fb6-53ea-4cda-a1fd-202620d8c291 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e9a3d5404954e98a005b18a2d9680d0'} {{(pid=98588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 20:56:17.043344 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [None req-cfd52fb6-53ea-4cda-a1fd-202620d8c291 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e9a3d5404954e98a005b18a2d9680d0'} {{(pid=98588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 20:56:17.164813 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [None req-cfd52fb6-53ea-4cda-a1fd-202620d8c291 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e9a3d5404954e98a005b18a2d9680d0'} {{(pid=98588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 20:56:17.188809 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 558/1122] 10.222.0.26 () {58 vars in 1223 bytes} [Sat Apr 30 20:56:16 2022] DELETE /identity/v3/users/7e9a3d5404954e98a005b18a2d9680d0 => generated 0 bytes in 1094 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 20:56:17.193183 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9f93a-f423-4d4d-b5f6-850988b15f77 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:56:17.193669 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9f93a-f423-4d4d-b5f6-850988b15f77 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:56:17.193777 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9f93a-f423-4d4d-b5f6-850988b15f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:56:17.214323 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-74b9f93a-f423-4d4d-b5f6-850988b15f77 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:56:17.215513 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-74b9f93a-f423-4d4d-b5f6-850988b15f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:56:17.272001 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 565/1123] 10.222.0.26 () {58 vars in 957 bytes} [Sat Apr 30 20:56:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:56:17.281386 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd52fb6-53ea-4cda-a1fd-202620d8c291 admin admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:56:17.283309 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-cfd52fb6-53ea-4cda-a1fd-202620d8c291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:56:17.356255 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd52fb6-53ea-4cda-a1fd-202620d8c291 admin admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:56:17.359795 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ba1a1-4cb4-44c5-9890-67a43ca12647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:56:17.360512 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ba1a1-4cb4-44c5-9890-67a43ca12647 service neutron] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:56:17.360784 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ba1a1-4cb4-44c5-9890-67a43ca12647 service neutron] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:56:17.361087 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ba1a1-4cb4-44c5-9890-67a43ca12647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:56:17.369719 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ba1a1-4cb4-44c5-9890-67a43ca12647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:56:17.371142 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ba1a1-4cb4-44c5-9890-67a43ca12647 service neutron] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:56:17.380452 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 559/1124] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:56:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:56:17.938628 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9f93a-f423-4d4d-b5f6-850988b15f77 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:56:17.940069 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-74b9f93a-f423-4d4d-b5f6-850988b15f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:56:17.952350 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9f93a-f423-4d4d-b5f6-850988b15f77 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:56:17.957632 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f4e2b-24e3-4cae-afc0-6e4369a95afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:56:17.959927 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f4e2b-24e3-4cae-afc0-6e4369a95afc admin admin] REQUEST_METHOD: `DELETE` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:56:17.960558 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f4e2b-24e3-4cae-afc0-6e4369a95afc admin admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:56:17.960838 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f4e2b-24e3-4cae-afc0-6e4369a95afc admin admin] PATH_INFO: `/v3/projects/66efe6375d924cf8a85810eda1f2dd9c` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:56:17.962059 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2f4e2b-24e3-4cae-afc0-6e4369a95afc admin admin] RBAC: Authorizing `identity:delete_project(project_id=66efe6375d924cf8a85810eda1f2dd9c)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:56:17.963086 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: WARNING py.warnings [None req-3f2f4e2b-24e3-4cae-afc0-6e4369a95afc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 20:56:17.963086 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: warnings.warn(msg) Apr 30 20:56:17.963086 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: Apr 30 20:56:17.965512 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2f4e2b-24e3-4cae-afc0-6e4369a95afc admin admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:56:18.102714 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [None req-3f2f4e2b-24e3-4cae-afc0-6e4369a95afc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66efe6375d924cf8a85810eda1f2dd9c', 'request_id': 'req-3f2f4e2b-24e3-4cae-afc0-6e4369a95afc'} {{(pid=98587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 20:56:18.116256 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [None req-3f2f4e2b-24e3-4cae-afc0-6e4369a95afc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66efe6375d924cf8a85810eda1f2dd9c', 'request_id': 'req-3f2f4e2b-24e3-4cae-afc0-6e4369a95afc'} {{(pid=98587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 20:56:18.122275 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [None req-3f2f4e2b-24e3-4cae-afc0-6e4369a95afc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66efe6375d924cf8a85810eda1f2dd9c', 'request_id': 'req-3f2f4e2b-24e3-4cae-afc0-6e4369a95afc'} {{(pid=98587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 20:56:18.222954 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [None req-3f2f4e2b-24e3-4cae-afc0-6e4369a95afc admin admin] The token cache is being invalidate because project 66efe6375d924cf8a85810eda1f2dd9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 20:56:18.223631 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [None req-3f2f4e2b-24e3-4cae-afc0-6e4369a95afc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 20:56:18.223944 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [None req-3f2f4e2b-24e3-4cae-afc0-6e4369a95afc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 20:56:18.225608 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 566/1125] 10.222.0.26 () {58 vars in 1232 bytes} [Sat Apr 30 20:56:17 2022] DELETE /identity/v3/projects/66efe6375d924cf8a85810eda1f2dd9c => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:57:37.913504 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1964b4-83bb-423c-a204-983911948e57 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:57:37.914173 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1964b4-83bb-423c-a204-983911948e57 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:57:37.914173 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1964b4-83bb-423c-a204-983911948e57 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:57:37.915455 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 560/1126] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 30 20:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:57:37.920287 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f32fe-3649-4de4-a406-a3a24dfd842f None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:57:37.923487 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f32fe-3649-4de4-a406-a3a24dfd842f None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:57:37.923487 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f32fe-3649-4de4-a406-a3a24dfd842f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:57:37.939336 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-991f32fe-3649-4de4-a406-a3a24dfd842f None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:57:37.940531 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-991f32fe-3649-4de4-a406-a3a24dfd842f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:57:37.998938 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 567/1127] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 30 20:57:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:57:38.154262 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1964b4-83bb-423c-a204-983911948e57 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:57:38.155880 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-6c1964b4-83bb-423c-a204-983911948e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:57:38.224235 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1964b4-83bb-423c-a204-983911948e57 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:57:38.229212 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae689f4-3de1-4e57-ae51-818af3648a33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aee3a7a6b4b4d489993c131f3ae2048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:57:38.229870 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae689f4-3de1-4e57-ae51-818af3648a33 service nova] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:57:38.230149 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae689f4-3de1-4e57-ae51-818af3648a33 service nova] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:57:38.230422 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae689f4-3de1-4e57-ae51-818af3648a33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:57:38.238314 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae689f4-3de1-4e57-ae51-818af3648a33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:57:38.239892 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae689f4-3de1-4e57-ae51-818af3648a33 service nova] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:57:38.248873 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 561/1128] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:57:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:57:39.527728 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac217f39-0a6e-4836-a0b3-671473a7f8f1 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:57:39.528284 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac217f39-0a6e-4836-a0b3-671473a7f8f1 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:57:39.528284 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac217f39-0a6e-4836-a0b3-671473a7f8f1 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:57:39.529647 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 568/1129] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 30 20:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:57:39.535380 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d6a23-992f-40b0-96b4-ff8fa6043af4 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:57:39.535915 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d6a23-992f-40b0-96b4-ff8fa6043af4 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:57:39.536027 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d6a23-992f-40b0-96b4-ff8fa6043af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:57:39.554173 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-b70d6a23-992f-40b0-96b4-ff8fa6043af4 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:57:39.555363 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-b70d6a23-992f-40b0-96b4-ff8fa6043af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:57:39.563254 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 562/1130] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 30 20:57:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:57:39.716342 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac217f39-0a6e-4836-a0b3-671473a7f8f1 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:57:39.730406 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac217f39-0a6e-4836-a0b3-671473a7f8f1 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:57:39.736358 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11bcfdf-59f3-4e8d-8920-ac4b069b2204 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aee3a7a6b4b4d489993c131f3ae2048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:57:39.737026 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bcfdf-59f3-4e8d-8920-ac4b069b2204 service nova] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:57:39.737313 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bcfdf-59f3-4e8d-8920-ac4b069b2204 service nova] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:57:39.737590 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bcfdf-59f3-4e8d-8920-ac4b069b2204 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:57:39.745790 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11bcfdf-59f3-4e8d-8920-ac4b069b2204 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:57:39.747420 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11bcfdf-59f3-4e8d-8920-ac4b069b2204 service nova] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:57:39.757120 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 569/1131] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:57:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:57:43.375549 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624d4e4-1b00-4ed7-8685-a3dda13d6add None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:57:43.376124 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624d4e4-1b00-4ed7-8685-a3dda13d6add None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:57:43.376124 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624d4e4-1b00-4ed7-8685-a3dda13d6add None None] PATH_INFO: `/v3` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:57:43.377426 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 563/1132] 10.222.0.11 () {54 vars in 925 bytes} [Sat Apr 30 20:57:43 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:57:43.383900 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8f0b5-e37f-4b35-a9d7-d7cf8df3124e None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:57:43.384436 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8f0b5-e37f-4b35-a9d7-d7cf8df3124e None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:57:43.384940 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8f0b5-e37f-4b35-a9d7-d7cf8df3124e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:57:43.415437 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-3df8f0b5-e37f-4b35-a9d7-d7cf8df3124e None None] MFA Rules not processed for user `b6caa91b08d14b598502bfa806c90ebd`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:57:43.416717 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-3df8f0b5-e37f-4b35-a9d7-d7cf8df3124e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:57:43.478232 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 570/1133] 10.222.0.11 () {58 vars in 1015 bytes} [Sat Apr 30 20:57:43 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 20:57:51.504060 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe8d75-1d5e-4f3a-8096-5d5254abbf94 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:57:51.504658 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe8d75-1d5e-4f3a-8096-5d5254abbf94 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:57:51.504658 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe8d75-1d5e-4f3a-8096-5d5254abbf94 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:57:51.506097 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 564/1134] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 30 20:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:57:51.511304 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bf247-cad1-48b9-a46b-26266ab04a4f None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:57:51.511755 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bf247-cad1-48b9-a46b-26266ab04a4f None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:57:51.511864 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bf247-cad1-48b9-a46b-26266ab04a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:57:51.529713 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-d55bf247-cad1-48b9-a46b-26266ab04a4f None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:57:51.530879 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-d55bf247-cad1-48b9-a46b-26266ab04a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:57:51.539114 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 571/1135] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 30 20:57:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:57:51.694114 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe8d75-1d5e-4f3a-8096-5d5254abbf94 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:57:51.707387 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe8d75-1d5e-4f3a-8096-5d5254abbf94 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:57:51.712752 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452459c6-9316-4b5a-b84b-0e2078565393 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aee3a7a6b4b4d489993c131f3ae2048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:57:51.713406 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452459c6-9316-4b5a-b84b-0e2078565393 service nova] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:57:51.713686 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452459c6-9316-4b5a-b84b-0e2078565393 service nova] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:57:51.713958 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452459c6-9316-4b5a-b84b-0e2078565393 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:57:51.721834 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452459c6-9316-4b5a-b84b-0e2078565393 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:57:51.723390 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452459c6-9316-4b5a-b84b-0e2078565393 service nova] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:57:51.733117 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 565/1136] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:57:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:57:52.562991 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa662e-cbb6-406d-b1a6-cb52298389f7 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:57:52.563540 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa662e-cbb6-406d-b1a6-cb52298389f7 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:57:52.563540 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa662e-cbb6-406d-b1a6-cb52298389f7 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:57:52.564873 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 572/1137] 10.222.0.26 () {54 vars in 960 bytes} [Sat Apr 30 20:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:57:52.570488 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a967bf0-cb01-4a80-809b-3daaa48c466f None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:57:52.570944 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a967bf0-cb01-4a80-809b-3daaa48c466f None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:57:52.571053 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a967bf0-cb01-4a80-809b-3daaa48c466f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:57:52.589461 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-0a967bf0-cb01-4a80-809b-3daaa48c466f None None] MFA Rules not processed for user `b6caa91b08d14b598502bfa806c90ebd`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:57:52.590660 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-0a967bf0-cb01-4a80-809b-3daaa48c466f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:57:52.599730 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 566/1138] 10.222.0.26 () {58 vars in 1057 bytes} [Sat Apr 30 20:57:52 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:57:52.606828 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa662e-cbb6-406d-b1a6-cb52298389f7 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:57:52.620396 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa662e-cbb6-406d-b1a6-cb52298389f7 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:57:52.625300 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae5c61-8e50-4046-a23b-0bfa5ae342f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6caa91b08d14b598502bfa806c90ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:57:52.626031 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae5c61-8e50-4046-a23b-0bfa5ae342f7 service placement] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:57:52.626360 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae5c61-8e50-4046-a23b-0bfa5ae342f7 service placement] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:57:52.626636 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae5c61-8e50-4046-a23b-0bfa5ae342f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:57:52.635700 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae5c61-8e50-4046-a23b-0bfa5ae342f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:57:52.639429 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae5c61-8e50-4046-a23b-0bfa5ae342f7 service placement] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:57:52.647412 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 573/1139] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:57:52 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:57:53.022666 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a96f60-d17b-40dc-9cb9-b4708eeadfab None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:57:53.022953 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a96f60-d17b-40dc-9cb9-b4708eeadfab None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:57:53.023346 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a96f60-d17b-40dc-9cb9-b4708eeadfab None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:57:53.025100 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 567/1140] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 30 20:57:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:57:53.030149 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523f232-b3be-42ad-a696-2dc7303db41f None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:57:53.030437 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523f232-b3be-42ad-a696-2dc7303db41f None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:57:53.030716 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523f232-b3be-42ad-a696-2dc7303db41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:57:53.049244 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-3523f232-b3be-42ad-a696-2dc7303db41f None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:57:53.050437 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-3523f232-b3be-42ad-a696-2dc7303db41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:57:53.059037 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 574/1141] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 30 20:57:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:57:53.217264 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a96f60-d17b-40dc-9cb9-b4708eeadfab None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:57:53.230879 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a96f60-d17b-40dc-9cb9-b4708eeadfab None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:57:53.235763 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e28cbd-a8d6-44cc-a730-ed4166192ee0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aee3a7a6b4b4d489993c131f3ae2048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:57:53.236388 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e28cbd-a8d6-44cc-a730-ed4166192ee0 service nova] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:57:53.236666 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e28cbd-a8d6-44cc-a730-ed4166192ee0 service nova] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:57:53.236969 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e28cbd-a8d6-44cc-a730-ed4166192ee0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:57:53.244801 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e28cbd-a8d6-44cc-a730-ed4166192ee0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:57:53.246436 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e28cbd-a8d6-44cc-a730-ed4166192ee0 service nova] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:57:53.255443 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 568/1142] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:57:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:57:57.292203 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce51478-7495-40f7-9b1f-6047adc97f0e None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:57:57.292739 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce51478-7495-40f7-9b1f-6047adc97f0e None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:57:57.292739 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce51478-7495-40f7-9b1f-6047adc97f0e None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:57:57.294131 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 575/1143] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 30 20:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:57:57.299331 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d05a2-3ed3-48f0-b020-5c5dcf7294dc None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:57:57.299779 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d05a2-3ed3-48f0-b020-5c5dcf7294dc None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:57:57.300041 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d05a2-3ed3-48f0-b020-5c5dcf7294dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:57:57.318203 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-c19d05a2-3ed3-48f0-b020-5c5dcf7294dc None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:57:57.319412 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-c19d05a2-3ed3-48f0-b020-5c5dcf7294dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:57:57.327388 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 569/1144] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 30 20:57:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 20:57:57.364207 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce51478-7495-40f7-9b1f-6047adc97f0e None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:57:57.366491 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-2ce51478-7495-40f7-9b1f-6047adc97f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:57:57.420662 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce51478-7495-40f7-9b1f-6047adc97f0e None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:57:57.424129 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3ad65-0022-475c-b847-888db90e88fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:57:57.424761 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3ad65-0022-475c-b847-888db90e88fb service neutron] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:57:57.425067 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3ad65-0022-475c-b847-888db90e88fb service neutron] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:57:57.425343 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3ad65-0022-475c-b847-888db90e88fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:57:57.434664 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3ad65-0022-475c-b847-888db90e88fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:57:57.436098 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3ad65-0022-475c-b847-888db90e88fb service neutron] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:57:57.445202 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 576/1145] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:57:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:57:59.746866 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0330199-602d-47a1-8d53-01370c758b5f None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:57:59.747427 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0330199-602d-47a1-8d53-01370c758b5f None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:57:59.747427 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0330199-602d-47a1-8d53-01370c758b5f None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:57:59.748704 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 570/1146] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 30 20:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:57:59.753875 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac07be-af84-4411-86ed-d2100e54231d None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:57:59.754275 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac07be-af84-4411-86ed-d2100e54231d None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:57:59.754442 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac07be-af84-4411-86ed-d2100e54231d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:57:59.773158 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-57ac07be-af84-4411-86ed-d2100e54231d None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:57:59.774348 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-57ac07be-af84-4411-86ed-d2100e54231d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:57:59.782048 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 577/1147] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 30 20:57:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:57:59.817906 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0330199-602d-47a1-8d53-01370c758b5f None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:57:59.829107 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0330199-602d-47a1-8d53-01370c758b5f None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:57:59.832534 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c3c4c-3747-46fb-be43-a7735142f35b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:57:59.833197 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c3c4c-3747-46fb-be43-a7735142f35b service neutron] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:57:59.833475 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c3c4c-3747-46fb-be43-a7735142f35b service neutron] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:57:59.833747 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c3c4c-3747-46fb-be43-a7735142f35b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:57:59.843258 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c3c4c-3747-46fb-be43-a7735142f35b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:57:59.844675 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c3c4c-3747-46fb-be43-a7735142f35b service neutron] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:57:59.853782 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 571/1148] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:57:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:58:03.588226 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4a2a5-f6a2-4ee8-898a-c9246d289eed None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:58:03.588795 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4a2a5-f6a2-4ee8-898a-c9246d289eed None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:58:03.588795 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4a2a5-f6a2-4ee8-898a-c9246d289eed None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:58:03.590203 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 578/1149] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 30 20:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:58:03.595592 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47379beb-9ee8-4eb4-9813-7078e6aff720 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:58:03.595977 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47379beb-9ee8-4eb4-9813-7078e6aff720 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:58:03.596157 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47379beb-9ee8-4eb4-9813-7078e6aff720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:58:03.614438 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-47379beb-9ee8-4eb4-9813-7078e6aff720 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:58:03.616463 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-47379beb-9ee8-4eb4-9813-7078e6aff720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:58:03.624227 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 572/1150] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 30 20:58:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:58:03.901637 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4a2a5-f6a2-4ee8-898a-c9246d289eed None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:58:03.903301 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-08f4a2a5-f6a2-4ee8-898a-c9246d289eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:58:03.958755 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4a2a5-f6a2-4ee8-898a-c9246d289eed None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:58:03.962907 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4500942-f522-45ac-9793-058363585047 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec3374e008274f9eb4476b9f6a528fa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:58:03.963563 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4500942-f522-45ac-9793-058363585047 service cinder] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:58:03.963845 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4500942-f522-45ac-9793-058363585047 service cinder] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:58:03.964121 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4500942-f522-45ac-9793-058363585047 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:58:03.973269 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4500942-f522-45ac-9793-058363585047 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:58:03.975299 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4500942-f522-45ac-9793-058363585047 service cinder] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:58:03.984620 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 579/1151] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:58:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:58:06.337893 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048f78e-25ff-40d8-8278-ec26ea349c15 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:58:06.338433 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048f78e-25ff-40d8-8278-ec26ea349c15 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:58:06.338433 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048f78e-25ff-40d8-8278-ec26ea349c15 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:58:06.339796 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 573/1152] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 30 20:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:58:06.344846 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fa47b-2e85-43af-bc20-b06ed3aa730b None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:58:06.345275 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fa47b-2e85-43af-bc20-b06ed3aa730b None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:58:06.345442 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fa47b-2e85-43af-bc20-b06ed3aa730b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:58:06.363458 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-8c1fa47b-2e85-43af-bc20-b06ed3aa730b None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:58:06.364636 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-8c1fa47b-2e85-43af-bc20-b06ed3aa730b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:58:06.372893 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 580/1153] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 30 20:58:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:58:06.645490 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08237c4-b371-4124-b88a-6b43f5bbde4b None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:58:06.645777 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08237c4-b371-4124-b88a-6b43f5bbde4b None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:58:06.646055 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08237c4-b371-4124-b88a-6b43f5bbde4b None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:58:06.647503 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 574/1154] 10.222.0.26 () {54 vars in 963 bytes} [Sat Apr 30 20:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:58:06.652410 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4b559-ba77-47a1-a30b-0b66cf33c4ba None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:58:06.652769 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4b559-ba77-47a1-a30b-0b66cf33c4ba None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:58:06.653051 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4b559-ba77-47a1-a30b-0b66cf33c4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:58:06.671069 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-f6c4b559-ba77-47a1-a30b-0b66cf33c4ba None None] MFA Rules not processed for user `ec3374e008274f9eb4476b9f6a528fa6`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:58:06.672261 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-f6c4b559-ba77-47a1-a30b-0b66cf33c4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:58:06.679517 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 581/1155] 10.222.0.26 () {58 vars in 1060 bytes} [Sat Apr 30 20:58:06 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:58:06.687420 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08237c4-b371-4124-b88a-6b43f5bbde4b None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:58:06.699032 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08237c4-b371-4124-b88a-6b43f5bbde4b None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:58:06.702542 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb6555-d15d-4b88-a400-8734d1273c02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec3374e008274f9eb4476b9f6a528fa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:58:06.703172 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb6555-d15d-4b88-a400-8734d1273c02 service cinder] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:58:06.703460 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb6555-d15d-4b88-a400-8734d1273c02 service cinder] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:58:06.703740 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb6555-d15d-4b88-a400-8734d1273c02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:58:06.712744 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb6555-d15d-4b88-a400-8734d1273c02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:58:06.714345 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb6555-d15d-4b88-a400-8734d1273c02 service cinder] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:58:06.723531 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 575/1156] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:58:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:59:25.983125 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edd4f3-1774-4fae-beab-272601ace77f None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:25.983773 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edd4f3-1774-4fae-beab-272601ace77f None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:25.983773 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edd4f3-1774-4fae-beab-272601ace77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:25.989408 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a60cb-ae2d-4a5a-960a-cbe4ef07b6c6 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:25.989844 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a60cb-ae2d-4a5a-960a-cbe4ef07b6c6 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:25.989947 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a60cb-ae2d-4a5a-960a-cbe4ef07b6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:26.002224 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-29edd4f3-1774-4fae-beab-272601ace77f None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:59:26.003409 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-29edd4f3-1774-4fae-beab-272601ace77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:26.007997 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-905a60cb-ae2d-4a5a-960a-cbe4ef07b6c6 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:59:26.009210 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-905a60cb-ae2d-4a5a-960a-cbe4ef07b6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:26.011110 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 582/1157] 10.222.0.26 () {58 vars in 957 bytes} [Sat Apr 30 20:59:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:59:26.017269 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 576/1158] 10.222.0.26 () {58 vars in 957 bytes} [Sat Apr 30 20:59:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 20:59:26.020128 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5b2b2-f55f-456d-82ae-20cad15e65d8 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:26.020417 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5b2b2-f55f-456d-82ae-20cad15e65d8 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:26.020690 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5b2b2-f55f-456d-82ae-20cad15e65d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:26.026034 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ba47b-1cc6-4fbe-a0dc-d6b7eb801014 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:26.026329 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ba47b-1cc6-4fbe-a0dc-d6b7eb801014 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:26.026608 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ba47b-1cc6-4fbe-a0dc-d6b7eb801014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:26.038428 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-40c5b2b2-f55f-456d-82ae-20cad15e65d8 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:59:26.039608 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-40c5b2b2-f55f-456d-82ae-20cad15e65d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:26.045054 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-8d9ba47b-1cc6-4fbe-a0dc-d6b7eb801014 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:59:26.046214 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-8d9ba47b-1cc6-4fbe-a0dc-d6b7eb801014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:26.047995 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 583/1159] 10.222.0.26 () {58 vars in 957 bytes} [Sat Apr 30 20:59:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:59:26.052456 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5b2b2-f55f-456d-82ae-20cad15e65d8 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:26.053947 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 577/1160] 10.222.0.26 () {58 vars in 957 bytes} [Sat Apr 30 20:59:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 20:59:26.058243 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ba47b-1cc6-4fbe-a0dc-d6b7eb801014 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:26.061731 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5b2b2-f55f-456d-82ae-20cad15e65d8 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:26.066409 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef237a7-0034-4448-9dfe-406e3a46b710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:26.066989 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef237a7-0034-4448-9dfe-406e3a46b710 admin admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:26.067122 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ba47b-1cc6-4fbe-a0dc-d6b7eb801014 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:26.067281 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef237a7-0034-4448-9dfe-406e3a46b710 admin admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:26.067537 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef237a7-0034-4448-9dfe-406e3a46b710 admin admin] PATH_INFO: `/v3/domains` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:26.068242 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef237a7-0034-4448-9dfe-406e3a46b710 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:59:26.068546 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef237a7-0034-4448-9dfe-406e3a46b710 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:26.070902 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef237a7-0034-4448-9dfe-406e3a46b710 admin admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:26.079248 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591221d7-dd41-459d-b002-af9dd648f7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:26.079248 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591221d7-dd41-459d-b002-af9dd648f7e5 admin admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:26.079248 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591221d7-dd41-459d-b002-af9dd648f7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:26.079248 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591221d7-dd41-459d-b002-af9dd648f7e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:26.079624 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591221d7-dd41-459d-b002-af9dd648f7e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:59:26.079624 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591221d7-dd41-459d-b002-af9dd648f7e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:26.079624 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: WARNING py.warnings [None req-591221d7-dd41-459d-b002-af9dd648f7e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 20:59:26.079624 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: warnings.warn(msg) Apr 30 20:59:26.079624 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: Apr 30 20:59:26.079624 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591221d7-dd41-459d-b002-af9dd648f7e5 admin admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:26.082640 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 584/1161] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Apr 30 20:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:59:26.088960 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 578/1162] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Apr 30 20:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:59:26.091255 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef237a7-0034-4448-9dfe-406e3a46b710 admin admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:26.097053 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591221d7-dd41-459d-b002-af9dd648f7e5 admin admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:26.100930 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef237a7-0034-4448-9dfe-406e3a46b710 admin admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:26.105500 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcced7b7-029e-4e48-a003-f838c6f34b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:26.106131 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcced7b7-029e-4e48-a003-f838c6f34b3a admin admin] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:26.106411 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcced7b7-029e-4e48-a003-f838c6f34b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:26.106530 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591221d7-dd41-459d-b002-af9dd648f7e5 admin admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:26.106680 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcced7b7-029e-4e48-a003-f838c6f34b3a admin admin] PATH_INFO: `/v3/projects` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:26.107544 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcced7b7-029e-4e48-a003-f838c6f34b3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:26.108421 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: WARNING py.warnings [None req-fcced7b7-029e-4e48-a003-f838c6f34b3a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 20:59:26.108421 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: warnings.warn(msg) Apr 30 20:59:26.108421 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: Apr 30 20:59:26.109638 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcced7b7-029e-4e48-a003-f838c6f34b3a admin admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:26.111351 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515df21-e05b-487f-9eab-ff05706cedf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:26.111994 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515df21-e05b-487f-9eab-ff05706cedf4 admin admin] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:26.112276 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515df21-e05b-487f-9eab-ff05706cedf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:26.112552 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515df21-e05b-487f-9eab-ff05706cedf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:26.113275 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515df21-e05b-487f-9eab-ff05706cedf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:26.121351 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515df21-e05b-487f-9eab-ff05706cedf4 admin admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:26.222074 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 585/1163] 10.222.0.26 () {60 vars in 1152 bytes} [Sat Apr 30 20:59:26 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:59:26.226049 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcced7b7-029e-4e48-a003-f838c6f34b3a admin admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:26.230556 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 579/1164] 10.222.0.26 () {60 vars in 1152 bytes} [Sat Apr 30 20:59:26 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 20:59:26.234378 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515df21-e05b-487f-9eab-ff05706cedf4 admin admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:26.284888 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcced7b7-029e-4e48-a003-f838c6f34b3a admin admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:26.294714 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515df21-e05b-487f-9eab-ff05706cedf4 admin admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:26.300251 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1dc485-d23b-4511-8d3d-256abe69c482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:26.300943 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1dc485-d23b-4511-8d3d-256abe69c482 admin admin] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:26.301236 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1dc485-d23b-4511-8d3d-256abe69c482 admin admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:26.301515 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1dc485-d23b-4511-8d3d-256abe69c482 admin admin] PATH_INFO: `/v3/users` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:26.302202 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1dc485-d23b-4511-8d3d-256abe69c482 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:26.303214 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: WARNING py.warnings [None req-3d1dc485-d23b-4511-8d3d-256abe69c482 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 20:59:26.303214 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: warnings.warn(msg) Apr 30 20:59:26.303214 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: Apr 30 20:59:26.304439 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1dc485-d23b-4511-8d3d-256abe69c482 admin admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:26.339284 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de99d71-8c42-4e08-9245-2a75886b680c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:26.339943 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de99d71-8c42-4e08-9245-2a75886b680c admin admin] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:26.340226 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de99d71-8c42-4e08-9245-2a75886b680c admin admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:26.340494 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de99d71-8c42-4e08-9245-2a75886b680c admin admin] PATH_INFO: `/v3/users` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:26.341213 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de99d71-8c42-4e08-9245-2a75886b680c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:26.343133 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de99d71-8c42-4e08-9245-2a75886b680c admin admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:26.380024 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 580/1165] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Apr 30 20:59:26 2022] POST /identity/v3/users => generated 293 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 20:59:26.383982 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1dc485-d23b-4511-8d3d-256abe69c482 admin admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:26.394362 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1dc485-d23b-4511-8d3d-256abe69c482 admin admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:26.398889 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff64382-bd3e-4dd2-98f8-12c6e99fe86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:26.399520 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff64382-bd3e-4dd2-98f8-12c6e99fe86a admin admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:26.399798 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff64382-bd3e-4dd2-98f8-12c6e99fe86a admin admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:26.400067 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff64382-bd3e-4dd2-98f8-12c6e99fe86a admin admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:26.400762 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff64382-bd3e-4dd2-98f8-12c6e99fe86a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:26.402588 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff64382-bd3e-4dd2-98f8-12c6e99fe86a admin admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:26.412197 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 581/1166] 10.222.0.26 () {58 vars in 1121 bytes} [Sat Apr 30 20:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 20:59:26.415881 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff64382-bd3e-4dd2-98f8-12c6e99fe86a admin admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:26.425148 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff64382-bd3e-4dd2-98f8-12c6e99fe86a admin admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:26.428687 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 586/1167] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Apr 30 20:59:26 2022] POST /identity/v3/users => generated 290 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 20:59:26.429714 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed1cc8-e6ee-4604-80d3-a6e5b6f15ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:26.430744 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed1cc8-e6ee-4604-80d3-a6e5b6f15ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:26.430744 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed1cc8-e6ee-4604-80d3-a6e5b6f15ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:26.431023 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed1cc8-e6ee-4604-80d3-a6e5b6f15ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:26.431659 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed1cc8-e6ee-4604-80d3-a6e5b6f15ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:26.433278 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed1cc8-e6ee-4604-80d3-a6e5b6f15ae1 admin admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:26.434391 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de99d71-8c42-4e08-9245-2a75886b680c admin admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:26.444399 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de99d71-8c42-4e08-9245-2a75886b680c admin admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:26.444870 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 582/1168] 10.222.0.26 () {58 vars in 1121 bytes} [Sat Apr 30 20:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 20:59:26.448974 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed1cc8-e6ee-4604-80d3-a6e5b6f15ae1 admin admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:26.450339 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3dd11-1bdc-4f6f-b0c2-258ee832626a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:26.450918 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3dd11-1bdc-4f6f-b0c2-258ee832626a admin admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:26.451199 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3dd11-1bdc-4f6f-b0c2-258ee832626a admin admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:26.451472 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3dd11-1bdc-4f6f-b0c2-258ee832626a admin admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:26.452185 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3dd11-1bdc-4f6f-b0c2-258ee832626a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:26.453811 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3dd11-1bdc-4f6f-b0c2-258ee832626a admin admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:26.459010 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed1cc8-e6ee-4604-80d3-a6e5b6f15ae1 admin admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:26.463531 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0d066-66b5-4751-bc58-b3a6c1f5d5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:26.463687 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 587/1169] 10.222.0.26 () {58 vars in 1121 bytes} [Sat Apr 30 20:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 20:59:26.464393 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0d066-66b5-4751-bc58-b3a6c1f5d5ca admin admin] REQUEST_METHOD: `PUT` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:26.464677 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0d066-66b5-4751-bc58-b3a6c1f5d5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:26.465067 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0d066-66b5-4751-bc58-b3a6c1f5d5ca admin admin] PATH_INFO: `/v3/projects/7c0450ff165446e282ec646faea027b4/users/d4d9da217dae45fcba7813d93dc6a80e/roles/375abc9f701c408ea332eaf2d8a2e086` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:26.467509 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3dd11-1bdc-4f6f-b0c2-258ee832626a admin admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:26.479321 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3dd11-1bdc-4f6f-b0c2-258ee832626a admin admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:26.480064 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0d066-66b5-4751-bc58-b3a6c1f5d5ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0450ff165446e282ec646faea027b4, user_id=d4d9da217dae45fcba7813d93dc6a80e, role_id=375abc9f701c408ea332eaf2d8a2e086)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:26.482939 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0d066-66b5-4751-bc58-b3a6c1f5d5ca admin admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:26.485507 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b844026-2253-4671-ab42-60942eab6962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:26.486196 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b844026-2253-4671-ab42-60942eab6962 admin admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:26.486602 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b844026-2253-4671-ab42-60942eab6962 admin admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:26.486797 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b844026-2253-4671-ab42-60942eab6962 admin admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:26.487531 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b844026-2253-4671-ab42-60942eab6962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:26.489203 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b844026-2253-4671-ab42-60942eab6962 admin admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:26.499888 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 588/1170] 10.222.0.26 () {58 vars in 1121 bytes} [Sat Apr 30 20:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 20:59:26.503941 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b844026-2253-4671-ab42-60942eab6962 admin admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:26.514034 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b844026-2253-4671-ab42-60942eab6962 admin admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:26.520092 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6a69a-87a5-4635-a374-d45fa7b9276f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:26.520092 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6a69a-87a5-4635-a374-d45fa7b9276f admin admin] REQUEST_METHOD: `PUT` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:26.520092 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6a69a-87a5-4635-a374-d45fa7b9276f admin admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:26.520092 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6a69a-87a5-4635-a374-d45fa7b9276f admin admin] PATH_INFO: `/v3/projects/4b6c09358daf49e1956a321415530194/users/bb478f724c2145eea077d2d2e66609c3/roles/375abc9f701c408ea332eaf2d8a2e086` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:26.533764 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6a69a-87a5-4635-a374-d45fa7b9276f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b6c09358daf49e1956a321415530194, user_id=bb478f724c2145eea077d2d2e66609c3, role_id=375abc9f701c408ea332eaf2d8a2e086)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:26.534770 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: WARNING py.warnings [None req-dee6a69a-87a5-4635-a374-d45fa7b9276f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 20:59:26.534770 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: warnings.warn(msg) Apr 30 20:59:26.534770 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: Apr 30 20:59:26.536730 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6a69a-87a5-4635-a374-d45fa7b9276f admin admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:26.568410 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 583/1171] 10.222.0.26 () {60 vars in 1482 bytes} [Sat Apr 30 20:59:26 2022] PUT /identity/v3/projects/7c0450ff165446e282ec646faea027b4/users/d4d9da217dae45fcba7813d93dc6a80e/roles/375abc9f701c408ea332eaf2d8a2e086 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 20:59:26.573829 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d5a64-f456-4308-a7bf-46f9a8eb053d None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:26.574765 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d5a64-f456-4308-a7bf-46f9a8eb053d None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:26.575046 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d5a64-f456-4308-a7bf-46f9a8eb053d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:26.591336 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 589/1172] 10.222.0.26 () {60 vars in 1482 bytes} [Sat Apr 30 20:59:26 2022] PUT /identity/v3/projects/4b6c09358daf49e1956a321415530194/users/bb478f724c2145eea077d2d2e66609c3/roles/375abc9f701c408ea332eaf2d8a2e086 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 20:59:26.591499 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-a56d5a64-f456-4308-a7bf-46f9a8eb053d None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:59:26.592587 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-a56d5a64-f456-4308-a7bf-46f9a8eb053d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:26.597557 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6ab81-1fc4-4bc6-be09-93858106b994 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:26.597845 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6ab81-1fc4-4bc6-be09-93858106b994 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:26.598119 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6ab81-1fc4-4bc6-be09-93858106b994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:26.614604 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-2cb6ab81-1fc4-4bc6-be09-93858106b994 None None] MFA Rules not processed for user `71f9c03c5c0b40ce81ea052befa2a06c`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:59:26.615858 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-2cb6ab81-1fc4-4bc6-be09-93858106b994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:26.650215 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 584/1173] 10.222.0.26 () {58 vars in 957 bytes} [Sat Apr 30 20:59:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 20:59:26.664477 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d5a64-f456-4308-a7bf-46f9a8eb053d None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:26.669051 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-a56d5a64-f456-4308-a7bf-46f9a8eb053d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:26.678820 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 590/1174] 10.222.0.26 () {58 vars in 957 bytes} [Sat Apr 30 20:59:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 20:59:26.689252 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6ab81-1fc4-4bc6-be09-93858106b994 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:26.690630 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-2cb6ab81-1fc4-4bc6-be09-93858106b994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:26.722948 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d5a64-f456-4308-a7bf-46f9a8eb053d None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:26.726669 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41259fd-1cd3-4f04-8e8e-7164f10dbed0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:26.727471 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41259fd-1cd3-4f04-8e8e-7164f10dbed0 service neutron] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:26.727753 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41259fd-1cd3-4f04-8e8e-7164f10dbed0 service neutron] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:26.728025 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41259fd-1cd3-4f04-8e8e-7164f10dbed0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:26.737868 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41259fd-1cd3-4f04-8e8e-7164f10dbed0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:26.739319 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41259fd-1cd3-4f04-8e8e-7164f10dbed0 service neutron] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:26.748575 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6ab81-1fc4-4bc6-be09-93858106b994 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:26.748982 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 585/1175] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:59:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 20:59:26.752516 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb8a78-8089-496a-9c2f-15df1134b3c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:26.753205 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb8a78-8089-496a-9c2f-15df1134b3c5 service neutron] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:26.753494 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb8a78-8089-496a-9c2f-15df1134b3c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:26.753773 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb8a78-8089-496a-9c2f-15df1134b3c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:26.764404 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb8a78-8089-496a-9c2f-15df1134b3c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:26.766627 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb8a78-8089-496a-9c2f-15df1134b3c5 service neutron] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:26.776695 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 591/1176] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:59:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:59:33.121673 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cb70c-e7e1-4b7f-baba-4f1e78ca892e None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:33.122184 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cb70c-e7e1-4b7f-baba-4f1e78ca892e None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:33.122275 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cb70c-e7e1-4b7f-baba-4f1e78ca892e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:33.195769 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-9e7cb70c-e7e1-4b7f-baba-4f1e78ca892e None None] MFA Rules not processed for user `d4d9da217dae45fcba7813d93dc6a80e`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:59:33.197568 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-9e7cb70c-e7e1-4b7f-baba-4f1e78ca892e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:33.329572 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 586/1177] 10.222.0.26 () {58 vars in 957 bytes} [Sat Apr 30 20:59:33 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 20:59:33.333681 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb8a78-8089-496a-9c2f-15df1134b3c5 service neutron] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:33.344831 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb8a78-8089-496a-9c2f-15df1134b3c5 service neutron] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:33.350906 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48161b4-4ffc-4150-a03b-3d711861a721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:33.351880 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48161b4-4ffc-4150-a03b-3d711861a721 admin admin] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:33.352232 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48161b4-4ffc-4150-a03b-3d711861a721 admin admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:33.352603 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48161b4-4ffc-4150-a03b-3d711861a721 admin admin] PATH_INFO: `/v3/projects` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:33.353428 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48161b4-4ffc-4150-a03b-3d711861a721 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:33.356201 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48161b4-4ffc-4150-a03b-3d711861a721 admin admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:33.492410 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 592/1178] 10.222.0.26 () {60 vars in 1152 bytes} [Sat Apr 30 20:59:33 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:59:33.493352 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cb70c-e7e1-4b7f-baba-4f1e78ca892e None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:33.515904 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda6a55-023d-41a7-866f-6afc9e374f3f None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:33.516200 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda6a55-023d-41a7-866f-6afc9e374f3f None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:33.516483 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda6a55-023d-41a7-866f-6afc9e374f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:33.517971 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cb70c-e7e1-4b7f-baba-4f1e78ca892e None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:33.547478 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-2bda6a55-023d-41a7-866f-6afc9e374f3f None None] MFA Rules not processed for user `bb478f724c2145eea077d2d2e66609c3`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:59:33.548721 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-2bda6a55-023d-41a7-866f-6afc9e374f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:33.585823 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85ffd4-e600-4ce3-bb1a-6d809d472d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:33.587568 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85ffd4-e600-4ce3-bb1a-6d809d472d4b admin admin] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:33.588026 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85ffd4-e600-4ce3-bb1a-6d809d472d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:33.588514 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85ffd4-e600-4ce3-bb1a-6d809d472d4b admin admin] PATH_INFO: `/v3/users` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:33.589442 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85ffd4-e600-4ce3-bb1a-6d809d472d4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:33.592871 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85ffd4-e600-4ce3-bb1a-6d809d472d4b admin admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:33.621335 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 593/1179] 10.222.0.26 () {58 vars in 957 bytes} [Sat Apr 30 20:59:33 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 20:59:33.625764 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda6a55-023d-41a7-866f-6afc9e374f3f None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:33.636215 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda6a55-023d-41a7-866f-6afc9e374f3f None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:33.641467 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4d45a-f14b-48b3-9d51-b9059d537fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:33.642146 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4d45a-f14b-48b3-9d51-b9059d537fc8 admin admin] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:33.642433 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4d45a-f14b-48b3-9d51-b9059d537fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:33.642708 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4d45a-f14b-48b3-9d51-b9059d537fc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:33.643390 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d4d45a-f14b-48b3-9d51-b9059d537fc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:33.645353 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d4d45a-f14b-48b3-9d51-b9059d537fc8 admin admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:33.707326 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 587/1180] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Apr 30 20:59:33 2022] POST /identity/v3/users => generated 298 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 20:59:33.711643 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85ffd4-e600-4ce3-bb1a-6d809d472d4b admin admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:33.722007 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85ffd4-e600-4ce3-bb1a-6d809d472d4b admin admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:33.726563 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eec1a3-4c8b-4ade-a250-928eff71ea98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:33.727215 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eec1a3-4c8b-4ade-a250-928eff71ea98 admin admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:33.727498 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eec1a3-4c8b-4ade-a250-928eff71ea98 admin admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:33.727875 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eec1a3-4c8b-4ade-a250-928eff71ea98 admin admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:33.728587 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eec1a3-4c8b-4ade-a250-928eff71ea98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:33.730284 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eec1a3-4c8b-4ade-a250-928eff71ea98 admin admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:33.743825 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 588/1181] 10.222.0.26 () {58 vars in 1121 bytes} [Sat Apr 30 20:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 20:59:33.744819 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eec1a3-4c8b-4ade-a250-928eff71ea98 admin admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:33.754647 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eec1a3-4c8b-4ade-a250-928eff71ea98 admin admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:33.756443 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 594/1182] 10.222.0.26 () {60 vars in 1152 bytes} [Sat Apr 30 20:59:33 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 20:59:33.767761 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4d45a-f14b-48b3-9d51-b9059d537fc8 admin admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:33.837202 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921c2cd-2ab9-43b9-812f-caecb74d3442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:33.838687 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921c2cd-2ab9-43b9-812f-caecb74d3442 admin admin] REQUEST_METHOD: `PUT` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:33.839145 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921c2cd-2ab9-43b9-812f-caecb74d3442 admin admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:33.840469 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921c2cd-2ab9-43b9-812f-caecb74d3442 admin admin] PATH_INFO: `/v3/projects/33cda5b34ff0453d8aabf72f5b05dee7/users/46829c910a054bf59b1208a147ab544f/roles/31b3f11a82cd4cd2823e88aa0e931323` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:33.854050 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4d45a-f14b-48b3-9d51-b9059d537fc8 admin admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:33.859220 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921c2cd-2ab9-43b9-812f-caecb74d3442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33cda5b34ff0453d8aabf72f5b05dee7, user_id=46829c910a054bf59b1208a147ab544f, role_id=31b3f11a82cd4cd2823e88aa0e931323)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:33.859411 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e4f9c-1483-4789-81e1-521f818452d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:33.860324 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e4f9c-1483-4789-81e1-521f818452d7 admin admin] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:33.860611 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e4f9c-1483-4789-81e1-521f818452d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:33.861027 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e4f9c-1483-4789-81e1-521f818452d7 admin admin] PATH_INFO: `/v3/users` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:33.863459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921c2cd-2ab9-43b9-812f-caecb74d3442 admin admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:33.866884 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e4f9c-1483-4789-81e1-521f818452d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:33.869501 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e4f9c-1483-4789-81e1-521f818452d7 admin admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:34.012615 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 589/1183] 10.222.0.26 () {60 vars in 1482 bytes} [Sat Apr 30 20:59:33 2022] PUT /identity/v3/projects/33cda5b34ff0453d8aabf72f5b05dee7/users/46829c910a054bf59b1208a147ab544f/roles/31b3f11a82cd4cd2823e88aa0e931323 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 20:59:34.027093 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921c2cd-2ab9-43b9-812f-caecb74d3442 admin admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:34.112088 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 595/1184] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Apr 30 20:59:33 2022] POST /identity/v3/users => generated 295 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:59:34.116127 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e4f9c-1483-4789-81e1-521f818452d7 admin admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:34.119896 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921c2cd-2ab9-43b9-812f-caecb74d3442 admin admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:34.127116 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e4f9c-1483-4789-81e1-521f818452d7 admin admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:34.132692 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775aa1a-3e0b-4bed-99fb-a8f6e1e53940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:34.133413 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775aa1a-3e0b-4bed-99fb-a8f6e1e53940 admin admin] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:34.133672 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775aa1a-3e0b-4bed-99fb-a8f6e1e53940 admin admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:34.133943 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775aa1a-3e0b-4bed-99fb-a8f6e1e53940 admin admin] PATH_INFO: `/v3/roles` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:34.134666 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c775aa1a-3e0b-4bed-99fb-a8f6e1e53940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:34.134793 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203892a-48d7-4f7e-9ccd-ae6f3d130375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:34.136112 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203892a-48d7-4f7e-9ccd-ae6f3d130375 admin admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:34.136264 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c775aa1a-3e0b-4bed-99fb-a8f6e1e53940 admin admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:34.136441 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203892a-48d7-4f7e-9ccd-ae6f3d130375 admin admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:34.136838 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203892a-48d7-4f7e-9ccd-ae6f3d130375 admin admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:34.137851 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3203892a-48d7-4f7e-9ccd-ae6f3d130375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:34.139547 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3203892a-48d7-4f7e-9ccd-ae6f3d130375 admin admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:34.155024 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 590/1185] 10.222.0.26 () {58 vars in 1121 bytes} [Sat Apr 30 20:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 20:59:34.158790 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203892a-48d7-4f7e-9ccd-ae6f3d130375 admin admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:34.168622 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 596/1186] 10.222.0.26 () {58 vars in 1121 bytes} [Sat Apr 30 20:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 20:59:34.169796 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775aa1a-3e0b-4bed-99fb-a8f6e1e53940 admin admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:34.173277 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203892a-48d7-4f7e-9ccd-ae6f3d130375 admin admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:34.178804 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50876b-f3b9-4360-ba5e-70783fb6a8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:34.179986 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50876b-f3b9-4360-ba5e-70783fb6a8fd admin admin] REQUEST_METHOD: `PUT` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:34.180755 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50876b-f3b9-4360-ba5e-70783fb6a8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:34.181258 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50876b-f3b9-4360-ba5e-70783fb6a8fd admin admin] PATH_INFO: `/v3/projects/33cda5b34ff0453d8aabf72f5b05dee7/users/46829c910a054bf59b1208a147ab544f/roles/31b3f11a82cd4cd2823e88aa0e931323` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:34.184623 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50876b-f3b9-4360-ba5e-70783fb6a8fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=33cda5b34ff0453d8aabf72f5b05dee7, user_id=46829c910a054bf59b1208a147ab544f, role_id=31b3f11a82cd4cd2823e88aa0e931323)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:34.187549 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50876b-f3b9-4360-ba5e-70783fb6a8fd admin admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:34.193474 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775aa1a-3e0b-4bed-99fb-a8f6e1e53940 admin admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:34.200460 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec70aa7-340b-496c-868f-e0c116c1608e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:34.202163 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec70aa7-340b-496c-868f-e0c116c1608e admin admin] REQUEST_METHOD: `PUT` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:34.202163 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec70aa7-340b-496c-868f-e0c116c1608e admin admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:34.202404 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec70aa7-340b-496c-868f-e0c116c1608e admin admin] PATH_INFO: `/v3/projects/16ad84ce17ae42f181808af580439c08/users/83cfecf2aecb44d2b8e47120195b7029/roles/31b3f11a82cd4cd2823e88aa0e931323` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:34.208070 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 591/1187] 10.222.0.26 () {60 vars in 1482 bytes} [Sat Apr 30 20:59:34 2022] PUT /identity/v3/projects/33cda5b34ff0453d8aabf72f5b05dee7/users/46829c910a054bf59b1208a147ab544f/roles/31b3f11a82cd4cd2823e88aa0e931323 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:59:34.238928 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec70aa7-340b-496c-868f-e0c116c1608e admin admin] RBAC: Authorizing `identity:create_grant(project_id=16ad84ce17ae42f181808af580439c08, user_id=83cfecf2aecb44d2b8e47120195b7029, role_id=31b3f11a82cd4cd2823e88aa0e931323)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:34.242882 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec70aa7-340b-496c-868f-e0c116c1608e admin admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:34.335855 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 597/1188] 10.222.0.26 () {60 vars in 1482 bytes} [Sat Apr 30 20:59:34 2022] PUT /identity/v3/projects/16ad84ce17ae42f181808af580439c08/users/83cfecf2aecb44d2b8e47120195b7029/roles/31b3f11a82cd4cd2823e88aa0e931323 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:59:34.339599 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50876b-f3b9-4360-ba5e-70783fb6a8fd admin admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:34.433025 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50876b-f3b9-4360-ba5e-70783fb6a8fd admin admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:34.499584 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b41463-1c68-4e9c-a25c-4ebe49abe1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:34.500290 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b41463-1c68-4e9c-a25c-4ebe49abe1bc admin admin] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:34.500572 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b41463-1c68-4e9c-a25c-4ebe49abe1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:34.500844 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b41463-1c68-4e9c-a25c-4ebe49abe1bc admin admin] PATH_INFO: `/v3/roles` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:34.501789 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b41463-1c68-4e9c-a25c-4ebe49abe1bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:34.503284 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b41463-1c68-4e9c-a25c-4ebe49abe1bc admin admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:34.518025 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 592/1189] 10.222.0.26 () {58 vars in 1121 bytes} [Sat Apr 30 20:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 20:59:34.520268 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec70aa7-340b-496c-868f-e0c116c1608e admin admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:34.538157 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec70aa7-340b-496c-868f-e0c116c1608e admin admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:34.544293 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f8322-97f6-4933-9394-65222b8e29b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:34.545265 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f8322-97f6-4933-9394-65222b8e29b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:34.546505 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f8322-97f6-4933-9394-65222b8e29b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:34.546959 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f8322-97f6-4933-9394-65222b8e29b3 admin admin] PATH_INFO: `/v3/projects/16ad84ce17ae42f181808af580439c08/users/83cfecf2aecb44d2b8e47120195b7029/roles/31b3f11a82cd4cd2823e88aa0e931323` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:34.549544 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f8322-97f6-4933-9394-65222b8e29b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16ad84ce17ae42f181808af580439c08, user_id=83cfecf2aecb44d2b8e47120195b7029, role_id=31b3f11a82cd4cd2823e88aa0e931323)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:34.553238 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f8322-97f6-4933-9394-65222b8e29b3 admin admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:34.576622 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 598/1190] 10.222.0.26 () {60 vars in 1482 bytes} [Sat Apr 30 20:59:34 2022] PUT /identity/v3/projects/16ad84ce17ae42f181808af580439c08/users/83cfecf2aecb44d2b8e47120195b7029/roles/31b3f11a82cd4cd2823e88aa0e931323 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:59:41.229431 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26e8ee-6549-4445-8e81-f524d3bbcfa2 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:41.229913 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26e8ee-6549-4445-8e81-f524d3bbcfa2 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:41.230112 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26e8ee-6549-4445-8e81-f524d3bbcfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:41.295794 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-de26e8ee-6549-4445-8e81-f524d3bbcfa2 None None] MFA Rules not processed for user `46829c910a054bf59b1208a147ab544f`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:59:41.297373 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-de26e8ee-6549-4445-8e81-f524d3bbcfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:41.410045 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 593/1191] 10.222.0.26 () {58 vars in 957 bytes} [Sat Apr 30 20:59:41 2022] POST /identity/v3/auth/tokens => generated 2877 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:59:41.427527 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f8322-97f6-4933-9394-65222b8e29b3 admin admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:41.429506 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-172f8322-97f6-4933-9394-65222b8e29b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:41.598415 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f8322-97f6-4933-9394-65222b8e29b3 admin admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:41.602404 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432983d-fc98-4dd0-8328-94971073096b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ed44bbd52047cbbcab1bc72d650b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:41.603054 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432983d-fc98-4dd0-8328-94971073096b service glance] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:41.603337 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432983d-fc98-4dd0-8328-94971073096b service glance] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:41.603647 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432983d-fc98-4dd0-8328-94971073096b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:41.714411 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432983d-fc98-4dd0-8328-94971073096b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:41.716498 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432983d-fc98-4dd0-8328-94971073096b service glance] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:41.728821 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 599/1192] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:59:41 2022] GET /identity/v3/auth/tokens => generated 2812 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:59:41.918707 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af1c2c-6ed2-460c-9067-b10c48643b70 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:41.918997 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af1c2c-6ed2-460c-9067-b10c48643b70 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:41.919608 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af1c2c-6ed2-460c-9067-b10c48643b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:41.970453 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-10af1c2c-6ed2-460c-9067-b10c48643b70 None None] MFA Rules not processed for user `83cfecf2aecb44d2b8e47120195b7029`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:59:41.972302 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-10af1c2c-6ed2-460c-9067-b10c48643b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:42.083878 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 594/1193] 10.222.0.26 () {58 vars in 957 bytes} [Sat Apr 30 20:59:41 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:59:42.100177 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432983d-fc98-4dd0-8328-94971073096b service glance] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:42.109250 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432983d-fc98-4dd0-8328-94971073096b service glance] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:42.113407 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ed0f9-3f1b-4681-bee5-33bb6f8fc916 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ed44bbd52047cbbcab1bc72d650b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:42.114451 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ed0f9-3f1b-4681-bee5-33bb6f8fc916 service glance] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:42.114891 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ed0f9-3f1b-4681-bee5-33bb6f8fc916 service glance] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:42.115328 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ed0f9-3f1b-4681-bee5-33bb6f8fc916 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:42.210889 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ed0f9-3f1b-4681-bee5-33bb6f8fc916 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:42.212411 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ed0f9-3f1b-4681-bee5-33bb6f8fc916 service glance] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:42.223808 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 600/1194] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:59:42 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:59:51.034310 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83bfd1-8342-4d14-9d67-3a692badcd00 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:51.034885 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83bfd1-8342-4d14-9d67-3a692badcd00 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:51.034885 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83bfd1-8342-4d14-9d67-3a692badcd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:51.054870 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-eb83bfd1-8342-4d14-9d67-3a692badcd00 None None] MFA Rules not processed for user `d4d9da217dae45fcba7813d93dc6a80e`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:59:51.056147 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-eb83bfd1-8342-4d14-9d67-3a692badcd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:51.064767 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 595/1195] 10.222.0.26 () {58 vars in 957 bytes} [Sat Apr 30 20:59:51 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:59:51.351290 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f52ae-6fe2-4db2-adad-81122f8c4b75 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:51.351761 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f52ae-6fe2-4db2-adad-81122f8c4b75 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:51.351938 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f52ae-6fe2-4db2-adad-81122f8c4b75 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:51.353375 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 601/1196] 10.222.0.26 () {54 vars in 960 bytes} [Sat Apr 30 20:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:59:51.359206 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2af20e-a193-45ad-8759-4a06f0e70ee8 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:51.359499 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2af20e-a193-45ad-8759-4a06f0e70ee8 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:51.359778 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2af20e-a193-45ad-8759-4a06f0e70ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:51.377776 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-6a2af20e-a193-45ad-8759-4a06f0e70ee8 None None] MFA Rules not processed for user `2aee3a7a6b4b4d489993c131f3ae2048`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:59:51.378994 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-6a2af20e-a193-45ad-8759-4a06f0e70ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:51.445514 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 596/1197] 10.222.0.26 () {58 vars in 1057 bytes} [Sat Apr 30 20:59:51 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:59:51.451182 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1539df0-158c-40e7-97d2-7f3ce9ce32dd None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:51.451472 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1539df0-158c-40e7-97d2-7f3ce9ce32dd None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:51.451754 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1539df0-158c-40e7-97d2-7f3ce9ce32dd None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:51.453122 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 602/1198] 10.222.0.26 () {54 vars in 912 bytes} [Sat Apr 30 20:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:59:51.457889 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52346c0-8fde-42ad-862e-9cb590b666e4 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:51.458260 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52346c0-8fde-42ad-862e-9cb590b666e4 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:51.460323 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52346c0-8fde-42ad-862e-9cb590b666e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:51.477840 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-c52346c0-8fde-42ad-862e-9cb590b666e4 None None] MFA Rules not processed for user `2aee3a7a6b4b4d489993c131f3ae2048`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:59:51.479141 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-c52346c0-8fde-42ad-862e-9cb590b666e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:51.488766 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 597/1199] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Apr 30 20:59:51 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:59:51.499942 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1539df0-158c-40e7-97d2-7f3ce9ce32dd None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:51.501778 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-c1539df0-158c-40e7-97d2-7f3ce9ce32dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:51.515257 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1539df0-158c-40e7-97d2-7f3ce9ce32dd None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:51.518807 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d364fe-e4c8-49d8-b30f-d39e924e7f2d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43ed44bbd52047cbbcab1bc72d650b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:51.519443 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d364fe-e4c8-49d8-b30f-d39e924e7f2d service glance] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:51.519725 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d364fe-e4c8-49d8-b30f-d39e924e7f2d service glance] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:51.519999 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d364fe-e4c8-49d8-b30f-d39e924e7f2d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:51.530300 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d364fe-e4c8-49d8-b30f-d39e924e7f2d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:51.531829 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d364fe-e4c8-49d8-b30f-d39e924e7f2d service glance] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:51.542664 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 603/1200] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:59:51 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:59:51.911511 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53b0ac-6034-42c6-ae3c-14e9b26ea8e1 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:51.911798 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53b0ac-6034-42c6-ae3c-14e9b26ea8e1 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:51.912072 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53b0ac-6034-42c6-ae3c-14e9b26ea8e1 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:51.913584 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 598/1201] 10.222.0.26 () {54 vars in 912 bytes} [Sat Apr 30 20:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:59:51.922873 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b44e8-1bcd-4dee-9c8a-5833497befc0 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:51.923351 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b44e8-1bcd-4dee-9c8a-5833497befc0 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:51.923637 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b44e8-1bcd-4dee-9c8a-5833497befc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:51.945535 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-ba6b44e8-1bcd-4dee-9c8a-5833497befc0 None None] MFA Rules not processed for user `9918e808c77e4017a64c96ad24164b37`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:59:51.947169 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-ba6b44e8-1bcd-4dee-9c8a-5833497befc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:52.004783 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 604/1202] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Apr 30 20:59:51 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:59:52.017151 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53b0ac-6034-42c6-ae3c-14e9b26ea8e1 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:52.027746 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53b0ac-6034-42c6-ae3c-14e9b26ea8e1 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:52.031429 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736f187-b3cf-473b-b5eb-1798d5ccf0cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:52.032143 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736f187-b3cf-473b-b5eb-1798d5ccf0cd service neutron] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:52.032506 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736f187-b3cf-473b-b5eb-1798d5ccf0cd service neutron] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:52.032853 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736f187-b3cf-473b-b5eb-1798d5ccf0cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:52.043484 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736f187-b3cf-473b-b5eb-1798d5ccf0cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:52.045764 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736f187-b3cf-473b-b5eb-1798d5ccf0cd service neutron] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:52.054616 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 599/1203] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:59:52 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:59:52.561018 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b218183-e0a5-4fe9-9383-986f55062fd9 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:52.561555 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b218183-e0a5-4fe9-9383-986f55062fd9 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:52.561640 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b218183-e0a5-4fe9-9383-986f55062fd9 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:52.563074 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 605/1204] 10.222.0.26 () {54 vars in 960 bytes} [Sat Apr 30 20:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:59:52.570496 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef3b59-52e4-4bb3-8e26-de1b7fdd97e8 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:52.570794 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef3b59-52e4-4bb3-8e26-de1b7fdd97e8 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:52.571082 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef3b59-52e4-4bb3-8e26-de1b7fdd97e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:52.574892 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fa10e-d5bc-486f-8583-2e7134dda614 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:52.575247 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fa10e-d5bc-486f-8583-2e7134dda614 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:52.575590 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fa10e-d5bc-486f-8583-2e7134dda614 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:52.577020 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 606/1205] 10.222.0.26 () {54 vars in 960 bytes} [Sat Apr 30 20:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:59:52.583107 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7dcd8b-c027-43b3-aec4-96ae4e5db472 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:52.583457 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7dcd8b-c027-43b3-aec4-96ae4e5db472 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:52.583781 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7dcd8b-c027-43b3-aec4-96ae4e5db472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:52.592551 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-92ef3b59-52e4-4bb3-8e26-de1b7fdd97e8 None None] MFA Rules not processed for user `2aee3a7a6b4b4d489993c131f3ae2048`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:59:52.593867 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-92ef3b59-52e4-4bb3-8e26-de1b7fdd97e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:52.602830 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-4a7dcd8b-c027-43b3-aec4-96ae4e5db472 None None] MFA Rules not processed for user `b6caa91b08d14b598502bfa806c90ebd`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:59:52.603849 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 600/1206] 10.222.0.26 () {58 vars in 1057 bytes} [Sat Apr 30 20:59:52 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:59:52.604100 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-4a7dcd8b-c027-43b3-aec4-96ae4e5db472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:52.610557 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fbe3a-3a2e-47d7-85cd-23419bc85396 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:52.610951 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fbe3a-3a2e-47d7-85cd-23419bc85396 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:52.611311 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fbe3a-3a2e-47d7-85cd-23419bc85396 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:52.612678 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 601/1207] 10.222.0.26 () {54 vars in 912 bytes} [Sat Apr 30 20:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:59:52.617760 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d55ff1-a833-4a38-acf1-de67df18aa75 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:52.618052 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d55ff1-a833-4a38-acf1-de67df18aa75 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:52.618335 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d55ff1-a833-4a38-acf1-de67df18aa75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:52.637932 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-74d55ff1-a833-4a38-acf1-de67df18aa75 None None] MFA Rules not processed for user `2aee3a7a6b4b4d489993c131f3ae2048`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:59:52.639294 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-74d55ff1-a833-4a38-acf1-de67df18aa75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:52.648609 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 602/1208] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Apr 30 20:59:52 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 20:59:52.660341 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d55ff1-a833-4a38-acf1-de67df18aa75 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:52.669794 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d55ff1-a833-4a38-acf1-de67df18aa75 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:52.673411 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1a6e3-9718-45df-8551-d17a9153b792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:52.674112 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1a6e3-9718-45df-8551-d17a9153b792 service neutron] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:52.674464 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1a6e3-9718-45df-8551-d17a9153b792 service neutron] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:52.674799 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1a6e3-9718-45df-8551-d17a9153b792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:52.675101 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 607/1209] 10.222.0.26 () {58 vars in 1057 bytes} [Sat Apr 30 20:59:52 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 20:59:52.682617 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7dcd8b-c027-43b3-aec4-96ae4e5db472 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:52.686343 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b1a6e3-9718-45df-8551-d17a9153b792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:52.687986 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b1a6e3-9718-45df-8551-d17a9153b792 service neutron] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:52.692189 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7dcd8b-c027-43b3-aec4-96ae4e5db472 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:52.697493 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15129f25-e5a2-41c3-857f-8e4260bd8eff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6caa91b08d14b598502bfa806c90ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:52.698152 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15129f25-e5a2-41c3-857f-8e4260bd8eff service placement] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:52.698481 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15129f25-e5a2-41c3-857f-8e4260bd8eff service placement] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:52.698761 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15129f25-e5a2-41c3-857f-8e4260bd8eff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:52.699816 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 603/1210] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:59:52 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 20:59:52.701348 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-15129f25-e5a2-41c3-857f-8e4260bd8eff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:52.713485 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15129f25-e5a2-41c3-857f-8e4260bd8eff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:52.715754 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15129f25-e5a2-41c3-857f-8e4260bd8eff service placement] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:52.729541 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 608/1211] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 20:59:52 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:00:06.137008 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087b7b0-85b8-4fba-b536-ad0f703c2b6a None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:06.137588 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087b7b0-85b8-4fba-b536-ad0f703c2b6a None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:06.137588 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087b7b0-85b8-4fba-b536-ad0f703c2b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:06.155722 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-f087b7b0-85b8-4fba-b536-ad0f703c2b6a None None] MFA Rules not processed for user `9918e808c77e4017a64c96ad24164b37`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:00:06.158781 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-f087b7b0-85b8-4fba-b536-ad0f703c2b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:00:06.163931 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 604/1212] 10.222.0.11 () {58 vars in 1015 bytes} [Sat Apr 30 21:00:06 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:00:06.175579 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15129f25-e5a2-41c3-857f-8e4260bd8eff service placement] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:00:06.184838 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15129f25-e5a2-41c3-857f-8e4260bd8eff service placement] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:00:06.188428 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e49c1-17dd-4496-84c6-3a439833023a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:00:06.189087 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e49c1-17dd-4496-84c6-3a439833023a service neutron] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:06.189368 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e49c1-17dd-4496-84c6-3a439833023a service neutron] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:06.189641 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e49c1-17dd-4496-84c6-3a439833023a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:06.197010 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e49c1-17dd-4496-84c6-3a439833023a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:00:06.199137 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e49c1-17dd-4496-84c6-3a439833023a service neutron] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:00:06.208531 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 609/1213] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 21:00:06 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:00:07.102527 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede504b4-156d-4a02-8882-fda3e7d8a093 None None] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:07.103469 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede504b4-156d-4a02-8882-fda3e7d8a093 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:07.103789 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede504b4-156d-4a02-8882-fda3e7d8a093 None None] PATH_INFO: `/` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:07.107103 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 605/1214] 10.222.0.26 () {54 vars in 921 bytes} [Sat Apr 30 21:00:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:00:07.115947 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d7d1f-a8be-45ae-b97c-51d1c42ab1fe None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:07.116288 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d7d1f-a8be-45ae-b97c-51d1c42ab1fe None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:07.116539 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d7d1f-a8be-45ae-b97c-51d1c42ab1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:07.162075 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-535d7d1f-a8be-45ae-b97c-51d1c42ab1fe None None] MFA Rules not processed for user `2aee3a7a6b4b4d489993c131f3ae2048`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:00:07.163309 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-535d7d1f-a8be-45ae-b97c-51d1c42ab1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:00:07.173658 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 610/1215] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Apr 30 21:00:07 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:00:07.222038 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede504b4-156d-4a02-8882-fda3e7d8a093 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:00:07.241003 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede504b4-156d-4a02-8882-fda3e7d8a093 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:00:07.248487 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235348e-f9c4-4f36-9c14-70e46a679841 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aee3a7a6b4b4d489993c131f3ae2048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:00:07.249678 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235348e-f9c4-4f36-9c14-70e46a679841 service nova] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:07.250431 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235348e-f9c4-4f36-9c14-70e46a679841 service nova] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:07.250431 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235348e-f9c4-4f36-9c14-70e46a679841 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:07.260325 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235348e-f9c4-4f36-9c14-70e46a679841 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:00:07.262798 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235348e-f9c4-4f36-9c14-70e46a679841 service nova] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:00:07.273108 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 606/1216] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 21:00:07 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:00:13.680654 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf0216-9505-4e3a-a4de-81042dcac4b7 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:13.681286 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf0216-9505-4e3a-a4de-81042dcac4b7 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:13.681286 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf0216-9505-4e3a-a4de-81042dcac4b7 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:13.683292 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 611/1217] 10.222.0.26 () {54 vars in 921 bytes} [Sat Apr 30 21:00:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:00:13.694066 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e931de4-c3ad-4daa-b0d6-d7fb362e64a3 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:13.694944 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e931de4-c3ad-4daa-b0d6-d7fb362e64a3 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:13.695224 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e931de4-c3ad-4daa-b0d6-d7fb362e64a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:13.713186 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-4e931de4-c3ad-4daa-b0d6-d7fb362e64a3 None None] MFA Rules not processed for user `2aee3a7a6b4b4d489993c131f3ae2048`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:00:13.714996 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-4e931de4-c3ad-4daa-b0d6-d7fb362e64a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:00:13.723403 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 607/1218] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Apr 30 21:00:13 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:00:13.739281 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf0216-9505-4e3a-a4de-81042dcac4b7 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:00:13.753415 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf0216-9505-4e3a-a4de-81042dcac4b7 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:00:13.758415 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74ab32-dbd8-42eb-b410-14db8afb7c66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aee3a7a6b4b4d489993c131f3ae2048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:00:13.759061 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74ab32-dbd8-42eb-b410-14db8afb7c66 service nova] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:13.759346 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74ab32-dbd8-42eb-b410-14db8afb7c66 service nova] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:13.759627 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74ab32-dbd8-42eb-b410-14db8afb7c66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:13.769373 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74ab32-dbd8-42eb-b410-14db8afb7c66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:00:13.771535 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74ab32-dbd8-42eb-b410-14db8afb7c66 service nova] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:00:13.785352 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 612/1219] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 21:00:13 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:00:26.714096 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e931de4-c3ad-4daa-b0d6-d7fb362e64a3 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:00:26.723935 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e931de4-c3ad-4daa-b0d6-d7fb362e64a3 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:00:26.727920 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac31e8-9963-4353-b797-c482266e288a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:00:26.751659 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac31e8-9963-4353-b797-c482266e288a service neutron] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:26.751659 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac31e8-9963-4353-b797-c482266e288a service neutron] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:26.751659 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac31e8-9963-4353-b797-c482266e288a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:26.751659 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac31e8-9963-4353-b797-c482266e288a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:00:26.751659 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac31e8-9963-4353-b797-c482266e288a service neutron] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:00:26.752964 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 608/1220] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 21:00:26 2022] GET /identity/v3/auth/tokens => generated 2877 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:00:32.815681 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532dae26-7305-440b-8085-53e39342dc30 None None] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:32.816702 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532dae26-7305-440b-8085-53e39342dc30 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:32.817504 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532dae26-7305-440b-8085-53e39342dc30 None None] PATH_INFO: `/` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:32.819664 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 613/1221] 10.222.0.26 () {54 vars in 921 bytes} [Sat Apr 30 21:00:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:00:32.847164 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110c143-9658-4a46-b7aa-6b3b49a4b112 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:32.847585 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110c143-9658-4a46-b7aa-6b3b49a4b112 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:32.847993 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110c143-9658-4a46-b7aa-6b3b49a4b112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:32.870653 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-3110c143-9658-4a46-b7aa-6b3b49a4b112 None None] MFA Rules not processed for user `2aee3a7a6b4b4d489993c131f3ae2048`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:00:32.872099 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-3110c143-9658-4a46-b7aa-6b3b49a4b112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:00:32.883231 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 609/1222] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Apr 30 21:00:32 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:00:32.899530 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532dae26-7305-440b-8085-53e39342dc30 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:00:32.926303 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532dae26-7305-440b-8085-53e39342dc30 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:00:32.931749 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fdc366-c2da-403f-a5f6-e2924cdf42b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aee3a7a6b4b4d489993c131f3ae2048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:00:32.932656 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdc366-c2da-403f-a5f6-e2924cdf42b6 service nova] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:32.933329 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdc366-c2da-403f-a5f6-e2924cdf42b6 service nova] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:32.933937 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdc366-c2da-403f-a5f6-e2924cdf42b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:32.943226 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fdc366-c2da-403f-a5f6-e2924cdf42b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:00:32.945383 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fdc366-c2da-403f-a5f6-e2924cdf42b6 service nova] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:00:32.964378 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 614/1223] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 21:00:32 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:01:51.506243 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187139f-a1f0-4fab-9229-8fd8488b8f85 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:51.506767 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187139f-a1f0-4fab-9229-8fd8488b8f85 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:51.506854 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187139f-a1f0-4fab-9229-8fd8488b8f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:51.534113 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-1187139f-a1f0-4fab-9229-8fd8488b8f85 None None] MFA Rules not processed for user `bb478f724c2145eea077d2d2e66609c3`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:01:51.535345 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-1187139f-a1f0-4fab-9229-8fd8488b8f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:01:51.563061 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 610/1224] 10.222.0.26 () {58 vars in 957 bytes} [Sat Apr 30 21:01:51 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:01:52.112897 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fef810-9450-4447-a1b2-d31adae2df98 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:52.113403 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fef810-9450-4447-a1b2-d31adae2df98 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:52.113493 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fef810-9450-4447-a1b2-d31adae2df98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:52.169250 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-42fef810-9450-4447-a1b2-d31adae2df98 None None] MFA Rules not processed for user `9918e808c77e4017a64c96ad24164b37`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:01:52.170437 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-42fef810-9450-4447-a1b2-d31adae2df98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:01:52.203450 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 615/1225] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Apr 30 21:01:52 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:01:52.213716 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187139f-a1f0-4fab-9229-8fd8488b8f85 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:01:52.224155 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187139f-a1f0-4fab-9229-8fd8488b8f85 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:01:52.227911 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf714530-8dff-48cb-9fc1-23a9fd29ed79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:01:52.228668 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf714530-8dff-48cb-9fc1-23a9fd29ed79 service neutron] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:52.229070 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf714530-8dff-48cb-9fc1-23a9fd29ed79 service neutron] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:52.229414 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf714530-8dff-48cb-9fc1-23a9fd29ed79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:52.238534 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf714530-8dff-48cb-9fc1-23a9fd29ed79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:01:52.240101 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf714530-8dff-48cb-9fc1-23a9fd29ed79 service neutron] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:01:52.248851 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 611/1226] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 21:01:52 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:02:02.089433 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fef810-9450-4447-a1b2-d31adae2df98 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:02:02.176837 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fef810-9450-4447-a1b2-d31adae2df98 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:02:02.181347 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd9998-2f1a-41a5-8d30-8828fabdc30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:02:02.182610 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd9998-2f1a-41a5-8d30-8828fabdc30b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:02:02.182610 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd9998-2f1a-41a5-8d30-8828fabdc30b admin admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:02:02.182779 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd9998-2f1a-41a5-8d30-8828fabdc30b admin admin] PATH_INFO: `/v3/users/d4d9da217dae45fcba7813d93dc6a80e` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:02:02.184004 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd9998-2f1a-41a5-8d30-8828fabdc30b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4d9da217dae45fcba7813d93dc6a80e)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:02:02.185070 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: WARNING py.warnings [None req-ffdd9998-2f1a-41a5-8d30-8828fabdc30b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:02:02.185070 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: warnings.warn(msg) Apr 30 21:02:02.185070 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: Apr 30 21:02:02.186321 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd9998-2f1a-41a5-8d30-8828fabdc30b admin admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:02:02.366089 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [None req-ffdd9998-2f1a-41a5-8d30-8828fabdc30b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4d9da217dae45fcba7813d93dc6a80e'} {{(pid=98587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:02:02.424406 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [None req-ffdd9998-2f1a-41a5-8d30-8828fabdc30b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4d9da217dae45fcba7813d93dc6a80e'} {{(pid=98587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:02:02.425074 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [None req-ffdd9998-2f1a-41a5-8d30-8828fabdc30b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4d9da217dae45fcba7813d93dc6a80e'} {{(pid=98587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:02:02.444472 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [None req-ffdd9998-2f1a-41a5-8d30-8828fabdc30b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4d9da217dae45fcba7813d93dc6a80e'} {{(pid=98587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:02:02.445157 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [None req-ffdd9998-2f1a-41a5-8d30-8828fabdc30b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4d9da217dae45fcba7813d93dc6a80e'} {{(pid=98587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:02:02.461353 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 616/1227] 10.222.0.26 () {58 vars in 1223 bytes} [Sat Apr 30 21:02:02 2022] DELETE /identity/v3/users/d4d9da217dae45fcba7813d93dc6a80e => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:02:02.710119 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf714530-8dff-48cb-9fc1-23a9fd29ed79 service neutron] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:02:02.722278 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf714530-8dff-48cb-9fc1-23a9fd29ed79 service neutron] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:02:02.779251 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8b341-31b3-48d6-9cbe-176e3b104b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:02:02.780109 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8b341-31b3-48d6-9cbe-176e3b104b24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:02:02.780393 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8b341-31b3-48d6-9cbe-176e3b104b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:02:02.780670 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8b341-31b3-48d6-9cbe-176e3b104b24 admin admin] PATH_INFO: `/v3/projects/7c0450ff165446e282ec646faea027b4` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:02:02.781898 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8b341-31b3-48d6-9cbe-176e3b104b24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c0450ff165446e282ec646faea027b4)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:02:02.782904 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: WARNING py.warnings [None req-ced8b341-31b3-48d6-9cbe-176e3b104b24 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:02:02.782904 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: warnings.warn(msg) Apr 30 21:02:02.782904 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: Apr 30 21:02:02.784106 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8b341-31b3-48d6-9cbe-176e3b104b24 admin admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:02:02.887667 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [None req-ced8b341-31b3-48d6-9cbe-176e3b104b24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c0450ff165446e282ec646faea027b4', 'request_id': 'req-ced8b341-31b3-48d6-9cbe-176e3b104b24'} {{(pid=98588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:02:02.995939 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [None req-ced8b341-31b3-48d6-9cbe-176e3b104b24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c0450ff165446e282ec646faea027b4', 'request_id': 'req-ced8b341-31b3-48d6-9cbe-176e3b104b24'} {{(pid=98588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:02:03.009273 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [None req-ced8b341-31b3-48d6-9cbe-176e3b104b24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c0450ff165446e282ec646faea027b4', 'request_id': 'req-ced8b341-31b3-48d6-9cbe-176e3b104b24'} {{(pid=98588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:02:03.032138 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [None req-ced8b341-31b3-48d6-9cbe-176e3b104b24 admin admin] The token cache is being invalidate because project 7c0450ff165446e282ec646faea027b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:02:03.032418 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [None req-ced8b341-31b3-48d6-9cbe-176e3b104b24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:02:03.033072 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [None req-ced8b341-31b3-48d6-9cbe-176e3b104b24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:02:03.034618 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 612/1228] 10.222.0.26 () {58 vars in 1232 bytes} [Sat Apr 30 21:02:02 2022] DELETE /identity/v3/projects/7c0450ff165446e282ec646faea027b4 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:02:03.038641 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd9998-2f1a-41a5-8d30-8828fabdc30b admin admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:02:03.040395 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-ffdd9998-2f1a-41a5-8d30-8828fabdc30b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:02:03.053685 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd9998-2f1a-41a5-8d30-8828fabdc30b admin admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:02:03.108382 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4657b93-eefd-4907-b901-51bf6dd5e5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:02:03.109408 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4657b93-eefd-4907-b901-51bf6dd5e5be admin admin] REQUEST_METHOD: `DELETE` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:02:03.109691 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4657b93-eefd-4907-b901-51bf6dd5e5be admin admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:02:03.110019 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4657b93-eefd-4907-b901-51bf6dd5e5be admin admin] PATH_INFO: `/v3/users/46829c910a054bf59b1208a147ab544f` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:02:03.111158 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4657b93-eefd-4907-b901-51bf6dd5e5be admin admin] RBAC: Authorizing `identity:delete_user(user_id=46829c910a054bf59b1208a147ab544f)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:02:03.113120 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4657b93-eefd-4907-b901-51bf6dd5e5be admin admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:02:03.327638 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [None req-f4657b93-eefd-4907-b901-51bf6dd5e5be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46829c910a054bf59b1208a147ab544f'} {{(pid=98587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:02:03.402458 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [None req-f4657b93-eefd-4907-b901-51bf6dd5e5be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46829c910a054bf59b1208a147ab544f'} {{(pid=98587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:02:03.403090 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [None req-f4657b93-eefd-4907-b901-51bf6dd5e5be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46829c910a054bf59b1208a147ab544f'} {{(pid=98587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:02:03.420097 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [None req-f4657b93-eefd-4907-b901-51bf6dd5e5be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46829c910a054bf59b1208a147ab544f'} {{(pid=98587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:02:03.420097 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [None req-f4657b93-eefd-4907-b901-51bf6dd5e5be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46829c910a054bf59b1208a147ab544f'} {{(pid=98587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:02:03.428736 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 617/1229] 10.222.0.26 () {58 vars in 1223 bytes} [Sat Apr 30 21:02:03 2022] DELETE /identity/v3/users/46829c910a054bf59b1208a147ab544f => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:02:03.672031 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8b341-31b3-48d6-9cbe-176e3b104b24 admin admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:02:03.673489 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-ced8b341-31b3-48d6-9cbe-176e3b104b24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:02:03.687195 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8b341-31b3-48d6-9cbe-176e3b104b24 admin admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:02:03.750376 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42345fd-70a8-4646-9620-fe70d86b46c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:02:03.751239 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42345fd-70a8-4646-9620-fe70d86b46c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:02:03.751516 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42345fd-70a8-4646-9620-fe70d86b46c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:02:03.751787 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42345fd-70a8-4646-9620-fe70d86b46c6 admin admin] PATH_INFO: `/v3/projects/33cda5b34ff0453d8aabf72f5b05dee7` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:02:03.752981 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42345fd-70a8-4646-9620-fe70d86b46c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33cda5b34ff0453d8aabf72f5b05dee7)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:02:03.754889 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42345fd-70a8-4646-9620-fe70d86b46c6 admin admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:02:03.910548 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [None req-f42345fd-70a8-4646-9620-fe70d86b46c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33cda5b34ff0453d8aabf72f5b05dee7', 'request_id': 'req-f42345fd-70a8-4646-9620-fe70d86b46c6'} {{(pid=98588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:02:03.972994 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [None req-f42345fd-70a8-4646-9620-fe70d86b46c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33cda5b34ff0453d8aabf72f5b05dee7', 'request_id': 'req-f42345fd-70a8-4646-9620-fe70d86b46c6'} {{(pid=98588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:02:03.979382 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [None req-f42345fd-70a8-4646-9620-fe70d86b46c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33cda5b34ff0453d8aabf72f5b05dee7', 'request_id': 'req-f42345fd-70a8-4646-9620-fe70d86b46c6'} {{(pid=98588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:02:03.990015 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [None req-f42345fd-70a8-4646-9620-fe70d86b46c6 admin admin] The token cache is being invalidate because project 33cda5b34ff0453d8aabf72f5b05dee7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:02:03.990330 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [None req-f42345fd-70a8-4646-9620-fe70d86b46c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:02:03.990956 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [None req-f42345fd-70a8-4646-9620-fe70d86b46c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:02:03.992491 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 613/1230] 10.222.0.26 () {58 vars in 1232 bytes} [Sat Apr 30 21:02:03 2022] DELETE /identity/v3/projects/33cda5b34ff0453d8aabf72f5b05dee7 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:02:31.588750 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e2014-db1f-4e07-ad4a-04d5a9d8e7e8 None None] REQUEST_METHOD: `POST` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:02:31.589279 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e2014-db1f-4e07-ad4a-04d5a9d8e7e8 None None] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:02:31.589370 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e2014-db1f-4e07-ad4a-04d5a9d8e7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:02:31.606550 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.auth.core [None req-bf0e2014-db1f-4e07-ad4a-04d5a9d8e7e8 None None] MFA Rules not processed for user `bb478f724c2145eea077d2d2e66609c3`. Rule list: `[]` (Enabled: `True`). {{(pid=98587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:02:31.607739 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-bf0e2014-db1f-4e07-ad4a-04d5a9d8e7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:02:31.660168 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 618/1231] 10.222.0.26 () {58 vars in 957 bytes} [Sat Apr 30 21:02:31 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:02:51.524083 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4d151-d204-4b29-8f0a-0f1b8eb1dfc5 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:02:51.524552 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4d151-d204-4b29-8f0a-0f1b8eb1dfc5 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:02:51.524641 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4d151-d204-4b29-8f0a-0f1b8eb1dfc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:02:51.543090 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-3ca4d151-d204-4b29-8f0a-0f1b8eb1dfc5 None None] MFA Rules not processed for user `bb478f724c2145eea077d2d2e66609c3`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:02:51.544291 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-3ca4d151-d204-4b29-8f0a-0f1b8eb1dfc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:02:51.551150 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 614/1232] 10.222.0.26 () {58 vars in 957 bytes} [Sat Apr 30 21:02:51 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:02:53.472128 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e2014-db1f-4e07-ad4a-04d5a9d8e7e8 None None] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:02:53.473747 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-bf0e2014-db1f-4e07-ad4a-04d5a9d8e7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:02:53.551676 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e2014-db1f-4e07-ad4a-04d5a9d8e7e8 None None] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:02:53.556617 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f521dde-af63-4082-a304-cc239f71e48b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6caa91b08d14b598502bfa806c90ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:02:53.557296 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f521dde-af63-4082-a304-cc239f71e48b service placement] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:02:53.559761 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f521dde-af63-4082-a304-cc239f71e48b service placement] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:02:53.559761 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f521dde-af63-4082-a304-cc239f71e48b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:02:53.559761 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-7f521dde-af63-4082-a304-cc239f71e48b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:02:53.570647 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f521dde-af63-4082-a304-cc239f71e48b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:02:53.572510 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f521dde-af63-4082-a304-cc239f71e48b service placement] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:02:53.581957 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 619/1233] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 21:02:53 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:04:14.145542 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922715fb-5d9c-4b6b-939c-9d58e56d5714 None None] REQUEST_METHOD: `POST` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:04:14.146008 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922715fb-5d9c-4b6b-939c-9d58e56d5714 None None] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:04:14.146102 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922715fb-5d9c-4b6b-939c-9d58e56d5714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:04:14.163604 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.auth.core [None req-922715fb-5d9c-4b6b-939c-9d58e56d5714 None None] MFA Rules not processed for user `bb478f724c2145eea077d2d2e66609c3`. Rule list: `[]` (Enabled: `True`). {{(pid=98588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:04:14.164956 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-922715fb-5d9c-4b6b-939c-9d58e56d5714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:04:14.172174 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 615/1234] 10.222.0.26 () {58 vars in 957 bytes} [Sat Apr 30 21:04:14 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:04:28.089100 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f521dde-af63-4082-a304-cc239f71e48b service placement] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:04:28.090493 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-7f521dde-af63-4082-a304-cc239f71e48b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:04:28.144285 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f521dde-af63-4082-a304-cc239f71e48b service placement] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:04:28.147800 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f644663-c720-4dc0-a508-e63a6ec14d09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:04:28.148438 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f644663-c720-4dc0-a508-e63a6ec14d09 service neutron] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:04:28.148715 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f644663-c720-4dc0-a508-e63a6ec14d09 service neutron] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:04:28.149015 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f644663-c720-4dc0-a508-e63a6ec14d09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:04:28.150883 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-9f644663-c720-4dc0-a508-e63a6ec14d09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:04:28.209423 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f644663-c720-4dc0-a508-e63a6ec14d09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:04:28.210968 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f644663-c720-4dc0-a508-e63a6ec14d09 service neutron] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:04:28.220092 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 620/1235] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 21:04:28 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:05:54.367671 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922715fb-5d9c-4b6b-939c-9d58e56d5714 None None] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:05:54.369143 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-922715fb-5d9c-4b6b-939c-9d58e56d5714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:05:54.381471 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922715fb-5d9c-4b6b-939c-9d58e56d5714 None None] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:05:54.385152 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e5949-1047-4b7d-937b-70b5e2bc567f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:05:54.385816 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e5949-1047-4b7d-937b-70b5e2bc567f service neutron] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:05:54.386124 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e5949-1047-4b7d-937b-70b5e2bc567f service neutron] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:05:54.386398 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e5949-1047-4b7d-937b-70b5e2bc567f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:05:54.388087 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-610e5949-1047-4b7d-937b-70b5e2bc567f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:05:54.397733 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e5949-1047-4b7d-937b-70b5e2bc567f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:05:54.399165 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e5949-1047-4b7d-937b-70b5e2bc567f service neutron] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:05:54.407061 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 616/1236] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 21:05:54 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:07:48.347696 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f644663-c720-4dc0-a508-e63a6ec14d09 service neutron] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:07:48.349205 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-9f644663-c720-4dc0-a508-e63a6ec14d09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:07:48.441308 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f644663-c720-4dc0-a508-e63a6ec14d09 service neutron] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:07:48.446501 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a4da6-acd0-4138-8635-cb2cb785c8e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aee3a7a6b4b4d489993c131f3ae2048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:07:48.447153 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a4da6-acd0-4138-8635-cb2cb785c8e9 service nova] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:07:48.447436 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a4da6-acd0-4138-8635-cb2cb785c8e9 service nova] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:07:48.447711 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a4da6-acd0-4138-8635-cb2cb785c8e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:07:48.449528 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-780a4da6-acd0-4138-8635-cb2cb785c8e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:07:48.460083 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a4da6-acd0-4138-8635-cb2cb785c8e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:07:48.461706 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a4da6-acd0-4138-8635-cb2cb785c8e9 service nova] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:07:48.470534 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 621/1237] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 21:07:48 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:07:50.513677 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e5949-1047-4b7d-937b-70b5e2bc567f service neutron] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:07:50.528552 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e5949-1047-4b7d-937b-70b5e2bc567f service neutron] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:07:50.533294 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38022e-07fa-4de8-9fa0-a33c0aafc77a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aee3a7a6b4b4d489993c131f3ae2048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:07:50.533951 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38022e-07fa-4de8-9fa0-a33c0aafc77a service nova] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:07:50.534226 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38022e-07fa-4de8-9fa0-a33c0aafc77a service nova] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:07:50.534679 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38022e-07fa-4de8-9fa0-a33c0aafc77a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:07:50.536495 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-6a38022e-07fa-4de8-9fa0-a33c0aafc77a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:07:50.549120 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38022e-07fa-4de8-9fa0-a33c0aafc77a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:07:50.551058 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38022e-07fa-4de8-9fa0-a33c0aafc77a service nova] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:07:50.561443 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 617/1238] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 21:07:50 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:07:50.919072 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a4da6-acd0-4138-8635-cb2cb785c8e9 service nova] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:07:50.927884 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a4da6-acd0-4138-8635-cb2cb785c8e9 service nova] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:07:50.931511 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617627d4-dc52-416a-99c2-24aa0cf10b2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:07:50.932226 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617627d4-dc52-416a-99c2-24aa0cf10b2a service neutron] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:07:50.932448 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617627d4-dc52-416a-99c2-24aa0cf10b2a service neutron] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:07:50.933380 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617627d4-dc52-416a-99c2-24aa0cf10b2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:07:50.935188 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-617627d4-dc52-416a-99c2-24aa0cf10b2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:07:50.948457 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617627d4-dc52-416a-99c2-24aa0cf10b2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:07:50.949956 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617627d4-dc52-416a-99c2-24aa0cf10b2a service neutron] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:07:50.961018 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 622/1239] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 21:07:50 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:07:52.144220 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38022e-07fa-4de8-9fa0-a33c0aafc77a service nova] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:07:52.153137 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38022e-07fa-4de8-9fa0-a33c0aafc77a service nova] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:07:52.158393 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7752699-c18e-448b-a9f5-6cde204994cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:07:52.159031 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7752699-c18e-448b-a9f5-6cde204994cd service neutron] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:07:52.159303 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7752699-c18e-448b-a9f5-6cde204994cd service neutron] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:07:52.159600 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7752699-c18e-448b-a9f5-6cde204994cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:07:52.161459 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-d7752699-c18e-448b-a9f5-6cde204994cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:07:52.174393 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7752699-c18e-448b-a9f5-6cde204994cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:07:52.176120 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7752699-c18e-448b-a9f5-6cde204994cd service neutron] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:07:52.186056 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 618/1240] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 21:07:52 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:07:53.330786 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617627d4-dc52-416a-99c2-24aa0cf10b2a service neutron] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:07:53.332293 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-617627d4-dc52-416a-99c2-24aa0cf10b2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:07:53.344821 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617627d4-dc52-416a-99c2-24aa0cf10b2a service neutron] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:07:53.350498 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c297c-4fcc-46a7-ae6c-7dc6a7e9f96f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aee3a7a6b4b4d489993c131f3ae2048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:07:53.351135 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c297c-4fcc-46a7-ae6c-7dc6a7e9f96f service nova] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:07:53.351419 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c297c-4fcc-46a7-ae6c-7dc6a7e9f96f service nova] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:07:53.351694 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c297c-4fcc-46a7-ae6c-7dc6a7e9f96f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:07:53.353489 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-d73c297c-4fcc-46a7-ae6c-7dc6a7e9f96f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:07:53.365876 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c297c-4fcc-46a7-ae6c-7dc6a7e9f96f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:07:53.368181 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c297c-4fcc-46a7-ae6c-7dc6a7e9f96f service nova] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:07:53.378135 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 623/1241] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 21:07:53 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:07:54.144225 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7752699-c18e-448b-a9f5-6cde204994cd service neutron] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:07:54.154892 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7752699-c18e-448b-a9f5-6cde204994cd service neutron] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:07:54.159833 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df252c6f-ccc2-48a6-b752-6fd9b9cd95fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6caa91b08d14b598502bfa806c90ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:07:54.160464 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df252c6f-ccc2-48a6-b752-6fd9b9cd95fc service placement] REQUEST_METHOD: `GET` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:07:54.160747 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df252c6f-ccc2-48a6-b752-6fd9b9cd95fc service placement] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:07:54.161065 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df252c6f-ccc2-48a6-b752-6fd9b9cd95fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:07:54.169346 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df252c6f-ccc2-48a6-b752-6fd9b9cd95fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:07:54.170943 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df252c6f-ccc2-48a6-b752-6fd9b9cd95fc service placement] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:07:54.180704 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 619/1242] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 21:07:54 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:08:02.387318 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c297c-4fcc-46a7-ae6c-7dc6a7e9f96f service nova] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:08:02.396271 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c297c-4fcc-46a7-ae6c-7dc6a7e9f96f service nova] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:08:02.400490 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df89bf8-7e6b-42f6-8b82-be1067fc2cd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918e808c77e4017a64c96ad24164b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ddbc3ac9ff421598cbe53e1252d289', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:08:02.401156 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df89bf8-7e6b-42f6-8b82-be1067fc2cd1 service neutron] REQUEST_METHOD: `GET` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:08:02.401438 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df89bf8-7e6b-42f6-8b82-be1067fc2cd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:08:02.401712 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df89bf8-7e6b-42f6-8b82-be1067fc2cd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:08:02.403460 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-7df89bf8-7e6b-42f6-8b82-be1067fc2cd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:08:02.463982 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df89bf8-7e6b-42f6-8b82-be1067fc2cd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:08:02.465487 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df89bf8-7e6b-42f6-8b82-be1067fc2cd1 service neutron] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:08:02.474737 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 624/1243] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Apr 30 21:08:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:08:09.259911 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df252c6f-ccc2-48a6-b752-6fd9b9cd95fc service placement] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:08:09.261420 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-df252c6f-ccc2-48a6-b752-6fd9b9cd95fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:08:09.275749 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df252c6f-ccc2-48a6-b752-6fd9b9cd95fc service placement] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:08:09.280397 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c995be2-4cec-4ef4-88f3-e8d0f4f46785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:08:09.281318 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c995be2-4cec-4ef4-88f3-e8d0f4f46785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:08:09.281596 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c995be2-4cec-4ef4-88f3-e8d0f4f46785 admin admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:08:09.281871 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c995be2-4cec-4ef4-88f3-e8d0f4f46785 admin admin] PATH_INFO: `/v3/users/bb478f724c2145eea077d2d2e66609c3` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:08:09.283046 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c995be2-4cec-4ef4-88f3-e8d0f4f46785 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb478f724c2145eea077d2d2e66609c3)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:08:09.285001 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c995be2-4cec-4ef4-88f3-e8d0f4f46785 admin admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:08:09.454169 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [None req-4c995be2-4cec-4ef4-88f3-e8d0f4f46785 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb478f724c2145eea077d2d2e66609c3'} {{(pid=98588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:08:09.460623 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [None req-4c995be2-4cec-4ef4-88f3-e8d0f4f46785 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb478f724c2145eea077d2d2e66609c3'} {{(pid=98588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:08:09.461388 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [None req-4c995be2-4cec-4ef4-88f3-e8d0f4f46785 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb478f724c2145eea077d2d2e66609c3'} {{(pid=98588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:08:09.461986 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [None req-4c995be2-4cec-4ef4-88f3-e8d0f4f46785 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb478f724c2145eea077d2d2e66609c3'} {{(pid=98588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:08:09.515244 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [None req-4c995be2-4cec-4ef4-88f3-e8d0f4f46785 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb478f724c2145eea077d2d2e66609c3'} {{(pid=98588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:08:09.532201 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 620/1244] 10.222.0.26 () {58 vars in 1223 bytes} [Sat Apr 30 21:08:09 2022] DELETE /identity/v3/users/bb478f724c2145eea077d2d2e66609c3 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:08:09.780721 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df89bf8-7e6b-42f6-8b82-be1067fc2cd1 service neutron] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:08:09.792054 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df89bf8-7e6b-42f6-8b82-be1067fc2cd1 service neutron] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:08:09.853127 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7bd715-b5d5-4d83-b2d8-c4e1d2068164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:08:09.853977 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bd715-b5d5-4d83-b2d8-c4e1d2068164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:08:09.854257 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bd715-b5d5-4d83-b2d8-c4e1d2068164 admin admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:08:09.854530 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bd715-b5d5-4d83-b2d8-c4e1d2068164 admin admin] PATH_INFO: `/v3/projects/4b6c09358daf49e1956a321415530194` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:08:09.855689 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7bd715-b5d5-4d83-b2d8-c4e1d2068164 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b6c09358daf49e1956a321415530194)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:08:09.857666 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7bd715-b5d5-4d83-b2d8-c4e1d2068164 admin admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:08:09.979532 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [None req-ce7bd715-b5d5-4d83-b2d8-c4e1d2068164 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b6c09358daf49e1956a321415530194', 'request_id': 'req-ce7bd715-b5d5-4d83-b2d8-c4e1d2068164'} {{(pid=98587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:08:09.985849 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [None req-ce7bd715-b5d5-4d83-b2d8-c4e1d2068164 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b6c09358daf49e1956a321415530194', 'request_id': 'req-ce7bd715-b5d5-4d83-b2d8-c4e1d2068164'} {{(pid=98587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:08:09.991170 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [None req-ce7bd715-b5d5-4d83-b2d8-c4e1d2068164 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b6c09358daf49e1956a321415530194', 'request_id': 'req-ce7bd715-b5d5-4d83-b2d8-c4e1d2068164'} {{(pid=98587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:08:10.059089 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [None req-ce7bd715-b5d5-4d83-b2d8-c4e1d2068164 admin admin] The token cache is being invalidate because project 4b6c09358daf49e1956a321415530194 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:08:10.059326 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [None req-ce7bd715-b5d5-4d83-b2d8-c4e1d2068164 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:08:10.059990 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [None req-ce7bd715-b5d5-4d83-b2d8-c4e1d2068164 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:08:10.061998 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 625/1245] 10.222.0.26 () {58 vars in 1232 bytes} [Sat Apr 30 21:08:09 2022] DELETE /identity/v3/projects/4b6c09358daf49e1956a321415530194 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:08:10.065893 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c995be2-4cec-4ef4-88f3-e8d0f4f46785 admin admin] Authenticating user token {{(pid=98588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:08:10.067771 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.fernet_utils [None req-4c995be2-4cec-4ef4-88f3-e8d0f4f46785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:08:10.093371 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c995be2-4cec-4ef4-88f3-e8d0f4f46785 admin admin] Validating token access rules against request {{(pid=98588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:08:10.167742 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77017a2e-ba45-41c8-af10-70f96bb6b556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:08:10.168874 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77017a2e-ba45-41c8-af10-70f96bb6b556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:08:10.169352 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77017a2e-ba45-41c8-af10-70f96bb6b556 admin admin] SCRIPT_NAME: `/identity` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:08:10.169790 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77017a2e-ba45-41c8-af10-70f96bb6b556 admin admin] PATH_INFO: `/v3/users/83cfecf2aecb44d2b8e47120195b7029` {{(pid=98588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:08:10.171171 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77017a2e-ba45-41c8-af10-70f96bb6b556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83cfecf2aecb44d2b8e47120195b7029)` {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:08:10.173406 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77017a2e-ba45-41c8-af10-70f96bb6b556 admin admin] RBAC: Authorization granted {{(pid=98588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:08:10.329819 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [None req-77017a2e-ba45-41c8-af10-70f96bb6b556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83cfecf2aecb44d2b8e47120195b7029'} {{(pid=98588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:08:10.337255 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [None req-77017a2e-ba45-41c8-af10-70f96bb6b556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83cfecf2aecb44d2b8e47120195b7029'} {{(pid=98588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:08:10.337925 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [None req-77017a2e-ba45-41c8-af10-70f96bb6b556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83cfecf2aecb44d2b8e47120195b7029'} {{(pid=98588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:08:10.338527 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [None req-77017a2e-ba45-41c8-af10-70f96bb6b556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83cfecf2aecb44d2b8e47120195b7029'} {{(pid=98588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:08:10.400929 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: DEBUG keystone.notifications [None req-77017a2e-ba45-41c8-af10-70f96bb6b556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83cfecf2aecb44d2b8e47120195b7029'} {{(pid=98588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:08:10.418720 dv-osbrick-master-4-ceph devstack@keystone.service[98588]: [pid: 98588|app: 0|req: 621/1246] 10.222.0.26 () {58 vars in 1223 bytes} [Sat Apr 30 21:08:10 2022] DELETE /identity/v3/users/83cfecf2aecb44d2b8e47120195b7029 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:08:10.654366 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7bd715-b5d5-4d83-b2d8-c4e1d2068164 admin admin] Authenticating user token {{(pid=98587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:08:10.655817 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.fernet_utils [None req-ce7bd715-b5d5-4d83-b2d8-c4e1d2068164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:08:10.668513 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7bd715-b5d5-4d83-b2d8-c4e1d2068164 admin admin] Validating token access rules against request {{(pid=98587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:08:10.724459 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18b89a-f907-48ff-97eb-8eb28be3b6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71f9c03c5c0b40ce81ea052befa2a06c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7eaab61e23a485db5f1e2bf1736a9f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:08:10.725349 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18b89a-f907-48ff-97eb-8eb28be3b6be admin admin] REQUEST_METHOD: `DELETE` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:08:10.725634 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18b89a-f907-48ff-97eb-8eb28be3b6be admin admin] SCRIPT_NAME: `/identity` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:08:10.725910 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18b89a-f907-48ff-97eb-8eb28be3b6be admin admin] PATH_INFO: `/v3/projects/16ad84ce17ae42f181808af580439c08` {{(pid=98587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:08:10.727199 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18b89a-f907-48ff-97eb-8eb28be3b6be admin admin] RBAC: Authorizing `identity:delete_project(project_id=16ad84ce17ae42f181808af580439c08)` {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:08:10.729159 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18b89a-f907-48ff-97eb-8eb28be3b6be admin admin] RBAC: Authorization granted {{(pid=98587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:08:10.835069 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [None req-1a18b89a-f907-48ff-97eb-8eb28be3b6be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16ad84ce17ae42f181808af580439c08', 'request_id': 'req-1a18b89a-f907-48ff-97eb-8eb28be3b6be'} {{(pid=98587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:08:10.841506 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [None req-1a18b89a-f907-48ff-97eb-8eb28be3b6be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16ad84ce17ae42f181808af580439c08', 'request_id': 'req-1a18b89a-f907-48ff-97eb-8eb28be3b6be'} {{(pid=98587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:08:10.846934 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [None req-1a18b89a-f907-48ff-97eb-8eb28be3b6be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16ad84ce17ae42f181808af580439c08', 'request_id': 'req-1a18b89a-f907-48ff-97eb-8eb28be3b6be'} {{(pid=98587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:08:10.908836 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [None req-1a18b89a-f907-48ff-97eb-8eb28be3b6be admin admin] The token cache is being invalidate because project 16ad84ce17ae42f181808af580439c08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:08:10.909100 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [None req-1a18b89a-f907-48ff-97eb-8eb28be3b6be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:08:10.909737 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: DEBUG keystone.notifications [None req-1a18b89a-f907-48ff-97eb-8eb28be3b6be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:08:10.911561 dv-osbrick-master-4-ceph devstack@keystone.service[98587]: [pid: 98587|app: 0|req: 626/1247] 10.222.0.26 () {58 vars in 1232 bytes} [Sat Apr 30 21:08:10 2022] DELETE /identity/v3/projects/16ad84ce17ae42f181808af580439c08 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0)